-- Logs begin at Mon 2022-02-07 02:01:39 UTC, end at Mon 2022-02-07 02:55:40 UTC. -- Feb 07 02:27:32.607550 dv-cinder-828061-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 07 02:27:32.616090 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 7 02:27:32 2022] *** Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: nodename: dv-cinder-828061-1-iscsi Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: machine: x86_64 Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: clock source: unix Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: pcre jit disabled Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: detected number of CPU cores: 4 Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: current working directory: / Feb 07 02:27:32.618046 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: detected binary path: /usr/bin/uwsgi-core Feb 07 02:27:32.618617 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: your processes number limit is 47680 Feb 07 02:27:32.618617 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: your memory page size is 4096 bytes Feb 07 02:27:32.618617 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: detected max file descriptor number: 2048 Feb 07 02:27:32.618617 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: lock engine: pthread robust mutexes Feb 07 02:27:32.618617 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: thunder lock: enabled Feb 07 02:27:32.618617 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 07 02:27:32.618617 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 07 02:27:32.663177 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: Python main interpreter initialized at 0x55d7181aa9c0 Feb 07 02:27:32.663177 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: python threads support enabled Feb 07 02:27:32.663177 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: your server socket listen backlog is limited to 100 connections Feb 07 02:27:32.663177 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: your mercy for graceful operations on workers is 90 seconds Feb 07 02:27:32.663524 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: mapped 403077 bytes (393 KB) for 2 cores Feb 07 02:27:32.663594 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: *** Operational MODE: preforking *** Feb 07 02:27:32.663851 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: *** uWSGI is running in multiple interpreter mode *** Feb 07 02:27:32.663851 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: spawned uWSGI master process (pid: 79265) Feb 07 02:27:32.664049 dv-cinder-828061-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 07 02:27:32.666258 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: spawned uWSGI worker 1 (pid: 79276, cores: 1) Feb 07 02:27:32.666258 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: spawned uWSGI worker 2 (pid: 79277, cores: 1) Feb 07 02:27:32.666258 dv-cinder-828061-1-iscsi devstack@keystone.service[79265]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 07 02:27:38.367174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 02:27:38.367174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: from cryptography.utils import int_from_bytes Feb 07 02:27:38.367963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 02:27:38.367963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: from cryptography.utils import int_from_bytes Feb 07 02:27:38.368391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 02:27:38.368391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: from cryptography.utils import int_from_bytes Feb 07 02:27:38.368516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 07 02:27:38.368516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: from cryptography.utils import int_from_bytes Feb 07 02:27:38.412217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 07 02:27:38.412381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 07 02:27:38.412469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 07 02:27:38.412559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 07 02:27:38.412645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] command line args: [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 07 02:27:38.412723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] command line args: [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 07 02:27:38.412867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 07 02:27:38.412997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 07 02:27:38.413083 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ================================================================================ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 07 02:27:38.413166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ================================================================================ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 07 02:27:38.413282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] admin_token = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.413418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] admin_token = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.413530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] config_dir = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.413667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] config_dir = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.413753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.413837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.413915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] config_source = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.414022 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] config_source = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.414106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] debug = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.414185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] debug = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.414268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.414521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.414654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.414760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.414863 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.414981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.415085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.415188 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.415820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.415925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.416034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.416140 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.416242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_config_append = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.416366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_config_append = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.416489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.416588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.416690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_dir = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.416796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_dir = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.416906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_file = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_file = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417428 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417624 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.417918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418079 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.418971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.419053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.419131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.419247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.419328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.419474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.419564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.419732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.419850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.420003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.420111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.420506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.420629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.420700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] publish_errors = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.420763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] publish_errors = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.420916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421285 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421360 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.421993 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] standard_threads = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] standard_threads = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422205 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_journal = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_journal = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.422993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_json = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.423075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_json = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.423158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_stderr = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.423230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_stderr = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.423300 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] use_syslog = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.423375 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_syslog = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.423506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.423586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 07 02:27:38.423760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.423848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.424004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.424083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.424265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.424366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.424525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.424606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.424769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.424856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.425010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.425095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.425257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.425336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.425492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.425577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.425740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.425824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.425984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.426063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.426232 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.426311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.426467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.426552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.426714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.426793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.426950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.427036 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.427196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.427275 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.427442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.427522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.427679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.427757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.427933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.428022 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.428184 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.428267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.428451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.428533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.428688 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.428776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.428941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.429020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.429198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.429277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.429452 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.429543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.429700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.429791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.429933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.430010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.430161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.430315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.430390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.430467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.430612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.430698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.430895 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.430981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.431148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.431257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.431381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.431614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.431698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.431862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.431948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.432111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.432263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.432390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.432542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.432638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.432785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.432865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.433036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.433121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.433269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.433360 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.433499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.433583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.433732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.433809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.433961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.434046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.434190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.434273 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.434420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.434504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.434651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.434737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.434884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.434968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.435120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.435230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.435351 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.435467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.435599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.435706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.435805 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.435899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.436025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.436108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.436258 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.436356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.436527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.436609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.436759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.436849 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.436996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.437078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.437229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.437317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.437465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.437557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.437697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.437820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.437935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.438021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.438163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.438242 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.438399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.438487 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.438631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.438710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.438865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.438955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.439095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.439182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.439331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.439411 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.439570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.439659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.439786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.439973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.440095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.440242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.441737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.441830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.441830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.441961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.442968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443778 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.443909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.444016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.444256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.444334 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.444522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.444604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.444787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.444867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.445065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.445145 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.445307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.445503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.445618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.445769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.445940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.446022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.446226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.446366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.446508 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.446826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.446960 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.447103 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.447262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.447401 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.447528 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.447703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.447834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.447963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.448150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.448287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.448451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.448617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.448742 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.448933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.449062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.449215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.external = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.449382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.449517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.449679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.449884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.450014 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.450191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.password = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.450379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.450577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] auth.token = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.450577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.450966 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.451416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.451416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.451806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.452069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.452282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.452521 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.452718 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.452901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.453029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.453172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.453306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.453431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.453556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.external = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.453681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.453806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.453938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.454080 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.454213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.454350 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.454482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.454482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.454736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.password = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.454867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.454996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.token = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.455126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.455255 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.455391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.455391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.455646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.455776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.455911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.456041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.456041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.456283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.456458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.456458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.456768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.456911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.456911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.457295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.457503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.457720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.457936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.458141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.458342 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.458567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.458775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.458979 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.459186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.459387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.459604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.459804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.460001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.460155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.460240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.460302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.460571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.460716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.460843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.460969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.461102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.461230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.461366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.461493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.461620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.461749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.461877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.461877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.462624 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.462832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.462972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.463101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.463228 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.463362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.463532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.463663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.463799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.463926 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.464053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.464053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.464302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.464453 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.464583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.464712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.464852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.464980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.465122 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.465256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.465256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.465256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.465256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.465731 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.465731 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.465989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.466116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.466245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.466374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.466374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.466588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.466653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.466718 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.466913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.466913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.467157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.467294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.467294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.467537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.467665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.467665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.467905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.468043 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.468217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.468386 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.468515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.468599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.468661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.468733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.468914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.469045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.469171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.469297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.469424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.469558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.469686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.469823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.469950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.470078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.470204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.470341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.470468 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.470594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.470722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.470848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.470848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.471096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.471224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.471351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.471477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.471613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.471754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.471754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.471994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.472121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.472254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.472398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.472533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.472665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.472791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.472916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.473041 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.473166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.473298 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.473441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.473568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.473692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.473818 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.473942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.473942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.474185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.474310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.474439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.474563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.474687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.474821 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.474969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.475931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476073 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476646 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476739 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476815 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476815 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.476945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.477016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.477088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.477167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.477308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.477391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.477577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.477657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.478405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.478500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.478650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.478756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.478890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.479033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.479138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.479310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.479398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.479584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.479665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.479859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.479938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.480093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.480181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.480357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.480520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.480603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.480763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.480858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.481018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.481099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.481279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.481359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.481524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.481613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.481759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.481846 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.481991 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.482070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.482230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.482317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.482465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.482544 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.482707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.482787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.482941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.483030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.483192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.483273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.483442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.483531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.483693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.483783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.483941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.484029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.484178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.484257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.484459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.484538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.484667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] role.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.484748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.484906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.484985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] role.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.485147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.485229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.485387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.485468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.485626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.485768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.485858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.486113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.486193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.486353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.486507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.486609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.486844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.486926 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.487092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.487173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.487333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.487415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.487570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.487652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.487807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.487887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.488055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.488135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.488299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.488544 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.488636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.488790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.488921 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.489042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.489237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.489319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.489536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.489656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.489777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.489897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.490029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.490153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.490281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.490481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.490561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.490753 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.490872 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.490992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.491240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.491321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.491474 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] role.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.491553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.491725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] role.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.491807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.491958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.492038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.492209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.492289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.492494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.492577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.492749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.492829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.492999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.493171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.493261 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.493514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.493595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.493765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.493869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.494017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.494123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.494253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.494366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.494502 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.494623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.494766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.494846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.494991 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.495072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.495239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.495321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.495542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.495654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.495782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.495893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.496040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.496145 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.496290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.496422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.496554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.496675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.496801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.496924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.497047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.497162 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.497295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.497420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.497533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.497674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.497764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.497916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.497996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.498149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.498229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.498383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.498472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.498618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.498699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.498871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.498951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.499126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.499215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.499378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.499459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.499616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.499706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.499853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.499933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.500086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.500168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.500322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.500424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.500585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.500666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.500821 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.500903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.501059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.501139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.501297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.501380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.501543 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.501625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.501781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.501861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.502025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.502106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.502267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.502347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.502516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.502597 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.502752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.502831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.502990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.503070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.503221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.503299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.503463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.503544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.503700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.503782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.503855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 07 02:27:38.503927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.504159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.504477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.504746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.504996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.505256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.505500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.505744 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.505982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.506223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.506463 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.506702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.506950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.507190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.507438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.507683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.507930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.508166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.508439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.508676 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.508950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.509194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 07 02:27:38.509365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 07 02:27:38.535327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.535559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.535798 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.535985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.536218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.536470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.544850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.545693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.573284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.573516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.574310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.574542 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.626069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.627482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.678024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.678262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.681304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.681542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.743965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.744167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.744304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.744488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.744619 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.744749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.744889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.744976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.745052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.745052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.745187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.745270 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.770257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.770461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.770565 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.770693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.770776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.770915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.771006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.771130 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.771214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.771343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.771436 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.771552 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.771636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.771764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.783773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.786139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.797010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.797243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.797471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.797695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.797913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.798128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.798347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79277) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.800487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.800886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.801278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.801617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.801792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.801998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.802208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 07 02:27:38.816474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.816669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.816766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 07 02:27:38.816881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 07 02:27:38.817005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.817203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 07 02:27:38.817287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.817399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 07 02:27:38.817483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.817665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.817749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.817921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.818011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.818176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.818259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.818430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.829956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.830232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.830331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.830500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.830666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.830779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.830930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.831201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.839410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.841146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.842636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.842914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.843193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.843472 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.843750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.844125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.844370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.844457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.844640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.844726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.844917 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.845000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.845194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.845286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.845461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.845543 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.845715 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.846094 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.846364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.846635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.846904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.847170 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.871392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.872865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.873002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.873280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.874560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.874835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.878459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.878692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.878968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.879956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.880231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.880530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.886628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.886908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.888144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.888447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.891404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.891690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.891971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.892251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.892554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.892812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.892897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.893083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.893210 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.893347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.893493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.893774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.894049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.894324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.894593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.894861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.912454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.912726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.913593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.913866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.917307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.918477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.920968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.921240 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.922057 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.922348 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.926160 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.927243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.929699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.930755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.933964 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.934263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.934545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.934825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.934979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.935096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.935274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.935379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.935563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.935840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.936133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.936415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.954787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.955083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.955444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.955690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.955776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.955981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.956246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.956531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.963479 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.964272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.965207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.965491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.965967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.966243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.968465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.968743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.969019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.969217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.969390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.969505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.969678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.969807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.970101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.970390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.982825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.983104 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.983380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.983495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:38.983658 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.983772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.983942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.984049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.984217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.984325 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.984519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.984633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.984906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:38.985176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.002598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.003250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.005815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.006459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.009692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.010263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.011276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.011847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.012903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.013180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.013476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.013583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.013750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.014025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.021810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.022416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.023399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.023996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.026591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.026880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.027161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.027257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.027446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.027530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.027729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.028012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.036914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.037203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.136833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.139593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.139905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.140194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.144811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79277) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.145095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.145373 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.146159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.146435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.146717 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.146987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.147261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.147525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.147809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.148078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.148362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.148628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.149030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79277) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.150101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 07 02:27:39.150445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.150794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.151271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.151736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.152063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.152359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.152648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.152931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.153215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.153484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.153744 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.154007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.154427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 07 02:27:39.186555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d7181aa9c0 pid: 79277 (default app) Feb 07 02:27:39.189987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc526b3-df37-4a0e-adc7-8cf49bcf8eeb None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:39.190282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc526b3-df37-4a0e-adc7-8cf49bcf8eeb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:39.190563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc526b3-df37-4a0e-adc7-8cf49bcf8eeb None None] PATH_INFO: `/v3` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:39.192697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d7181aa9c0 pid: 79276 (default app) Feb 07 02:27:39.194773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Mon Feb 7 02:27:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:47.403720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc377c-1a1a-4338-91f2-0410cf91270c None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:47.404232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc377c-1a1a-4338-91f2-0410cf91270c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:47.404313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc377c-1a1a-4338-91f2-0410cf91270c None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:47.409352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:27:47.414531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:47.414956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:47.415085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:47.445026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG oslo_db.sqlalchemy.engines [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 02:27:47.630495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG passlib.handlers.bcrypt [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79277) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 07 02:27:47.630942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG passlib.handlers.bcrypt [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79277) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 07 02:27:47.686306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:47.687899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:47.810897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:27:47.957936 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc377c-1a1a-4338-91f2-0410cf91270c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:47.991351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG oslo_db.sqlalchemy.engines [None req-53bc377c-1a1a-4338-91f2-0410cf91270c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 07 02:27:48.117515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc377c-1a1a-4338-91f2-0410cf91270c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:48.121772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3e9bd-bd16-4c5c-81de-a1c9fb6b35a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:48.122422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3e9bd-bd16-4c5c-81de-a1c9fb6b35a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:48.122698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3e9bd-bd16-4c5c-81de-a1c9fb6b35a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:48.122969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3e9bd-bd16-4c5c-81de-a1c9fb6b35a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:48.131023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3e9bd-bd16-4c5c-81de-a1c9fb6b35a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:48.182259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.common.rbac_enforcer.enforcer [None req-41d3e9bd-bd16-4c5c-81de-a1c9fb6b35a7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 07 02:27:48.182591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3e9bd-bd16-4c5c-81de-a1c9fb6b35a7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:48.191669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:27:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:27:48.197554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:48.212513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de663b-2a53-42b5-b6d4-946f4ba205a1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:48.216833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194b669-a797-4636-8dac-5fcd1de5042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:48.217947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194b669-a797-4636-8dac-5fcd1de5042e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:48.218232 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194b669-a797-4636-8dac-5fcd1de5042e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:48.218506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194b669-a797-4636-8dac-5fcd1de5042e admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:48.220044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194b669-a797-4636-8dac-5fcd1de5042e admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b1044bcdc94a2da05a52b6795082d0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:48.271012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5194b669-a797-4636-8dac-5fcd1de5042e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 07 02:27:48.271356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194b669-a797-4636-8dac-5fcd1de5042e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:48.276486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:27:48 2022] GET /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:50.440691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb03a1-a5f8-4407-8cd2-40c7cc5c8c4a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:50.441197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb03a1-a5f8-4407-8cd2-40c7cc5c8c4a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:50.441278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb03a1-a5f8-4407-8cd2-40c7cc5c8c4a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:50.445724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:27:50.451460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dbfa2-1ff7-4590-bef4-4d01a17fc0c2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:50.451874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dbfa2-1ff7-4590-bef4-4d01a17fc0c2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:50.452017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dbfa2-1ff7-4590-bef4-4d01a17fc0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:50.470903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-375dbfa2-1ff7-4590-bef4-4d01a17fc0c2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:50.472454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-375dbfa2-1ff7-4590-bef4-4d01a17fc0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:50.480876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:27:50.502268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb03a1-a5f8-4407-8cd2-40c7cc5c8c4a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:50.514001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb03a1-a5f8-4407-8cd2-40c7cc5c8c4a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:50.518189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13b4d-eb6e-4da9-942c-ac7f8ae6e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:50.518801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13b4d-eb6e-4da9-942c-ac7f8ae6e15f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:50.519085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13b4d-eb6e-4da9-942c-ac7f8ae6e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:50.519361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13b4d-eb6e-4da9-942c-ac7f8ae6e15f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:50.527370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f13b4d-eb6e-4da9-942c-ac7f8ae6e15f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:50.529148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f13b4d-eb6e-4da9-942c-ac7f8ae6e15f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:50.537612 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:27:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:27:50.543174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dbfa2-1ff7-4590-bef4-4d01a17fc0c2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:50.551872 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dbfa2-1ff7-4590-bef4-4d01a17fc0c2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:50.556292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de05f3-b6bb-48b4-95b2-6d4de8e1eeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:50.557155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de05f3-b6bb-48b4-95b2-6d4de8e1eeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:50.557433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de05f3-b6bb-48b4-95b2-6d4de8e1eeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:50.557703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de05f3-b6bb-48b4-95b2-6d4de8e1eeb9 admin admin] PATH_INFO: `/v3/users/e0df9a34c2c246f2a37da6d5472f7d68` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:50.559098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de05f3-b6bb-48b4-95b2-6d4de8e1eeb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0df9a34c2c246f2a37da6d5472f7d68)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:50.560947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de05f3-b6bb-48b4-95b2-6d4de8e1eeb9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:50.562489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:27:50 2022] GET /identity/v3/users/e0df9a34c2c246f2a37da6d5472f7d68 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:27:52.834698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048672-0d96-43d2-a613-1d5e706179dd None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:52.835202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048672-0d96-43d2-a613-1d5e706179dd None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:52.835285 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048672-0d96-43d2-a613-1d5e706179dd None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:52.835579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd8acd-588f-42a7-a4bd-e27105070043 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:52.835929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd8acd-588f-42a7-a4bd-e27105070043 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:52.836137 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd8acd-588f-42a7-a4bd-e27105070043 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:52.837128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:27:52.838390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:27:52.843946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf8147-0bae-4980-9c9f-4bb721d36a4f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:52.844149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624254a9-7e37-4079-8187-4168f8ddcd06 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:52.844255 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf8147-0bae-4980-9c9f-4bb721d36a4f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:52.844537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf8147-0bae-4980-9c9f-4bb721d36a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:52.844684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624254a9-7e37-4079-8187-4168f8ddcd06 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:52.845193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624254a9-7e37-4079-8187-4168f8ddcd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:52.865249 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-624254a9-7e37-4079-8187-4168f8ddcd06 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:52.866464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-624254a9-7e37-4079-8187-4168f8ddcd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:52.874642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:27:52.887673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG passlib.handlers.bcrypt [None req-1adf8147-0bae-4980-9c9f-4bb721d36a4f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79276) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 07 02:27:52.888084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG passlib.handlers.bcrypt [None req-1adf8147-0bae-4980-9c9f-4bb721d36a4f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79276) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 07 02:27:52.898397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624254a9-7e37-4079-8187-4168f8ddcd06 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:52.907498 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624254a9-7e37-4079-8187-4168f8ddcd06 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:52.911847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a2e8a-29ee-484d-84c3-f1b18d7bbde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:52.912652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a2e8a-29ee-484d-84c3-f1b18d7bbde7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:52.912936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a2e8a-29ee-484d-84c3-f1b18d7bbde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:52.913214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a2e8a-29ee-484d-84c3-f1b18d7bbde7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:52.926787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a2e8a-29ee-484d-84c3-f1b18d7bbde7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:27:52.934034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-682a2e8a-29ee-484d-84c3-f1b18d7bbde7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:27:52.935191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 8/13] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:27:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:27:52.935353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1adf8147-0bae-4980-9c9f-4bb721d36a4f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:52.937014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1adf8147-0bae-4980-9c9f-4bb721d36a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:52.940530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a2e8a-29ee-484d-84c3-f1b18d7bbde7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:52.949657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a2e8a-29ee-484d-84c3-f1b18d7bbde7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:52.954256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:52.954866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:52.955145 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:52.955419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:52.956163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:27:52.956501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:52.958225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:27:52.958225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:27:52.958225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:27:52.959112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:52.959194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 6/14] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:27:52.971888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 9/15] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:27:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:27:52.977105 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf8147-0bae-4980-9c9f-4bb721d36a4f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:52.981752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:52.986863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf8147-0bae-4980-9c9f-4bb721d36a4f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:52.991117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dc5f1-69a6-4c51-90d8-b975399bfc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:52.991241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc88f7-2188-41e6-89ba-2d5e47df77a4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:52.992289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dc5f1-69a6-4c51-90d8-b975399bfc83 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:52.992598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dc5f1-69a6-4c51-90d8-b975399bfc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:52.993535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dc5f1-69a6-4c51-90d8-b975399bfc83 admin admin] PATH_INFO: `/v3/users/e0df9a34c2c246f2a37da6d5472f7d68` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:52.995116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dc5f1-69a6-4c51-90d8-b975399bfc83 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0df9a34c2c246f2a37da6d5472f7d68)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:52.996123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58af4d-7170-4499-b42c-9dfc6e74e55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:52.996786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58af4d-7170-4499-b42c-9dfc6e74e55d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:52.996997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dc5f1-69a6-4c51-90d8-b975399bfc83 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:52.997086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58af4d-7170-4499-b42c-9dfc6e74e55d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:52.997314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58af4d-7170-4499-b42c-9dfc6e74e55d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:52.998730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 7/16] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:27:52 2022] GET /identity/v3/users/e0df9a34c2c246f2a37da6d5472f7d68 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:27:53.003457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dc5f1-69a6-4c51-90d8-b975399bfc83 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:53.005096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58af4d-7170-4499-b42c-9dfc6e74e55d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:53.006859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58af4d-7170-4499-b42c-9dfc6e74e55d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:53.012643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dc5f1-69a6-4c51-90d8-b975399bfc83 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:53.015568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 10/17] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:27:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 02:27:53.017182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0865c-aea1-4735-baa4-080575db3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:53.017910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0865c-aea1-4735-baa4-080575db3985 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:53.018192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0865c-aea1-4735-baa4-080575db3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:53.018468 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0865c-aea1-4735-baa4-080575db3985 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:53.019820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0865c-aea1-4735-baa4-080575db3985 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:53.020632 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58af4d-7170-4499-b42c-9dfc6e74e55d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:53.021320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0865c-aea1-4735-baa4-080575db3985 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:53.022996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 8/18] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:27:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:27:53.028007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0865c-aea1-4735-baa4-080575db3985 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:53.028744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58af4d-7170-4499-b42c-9dfc6e74e55d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:53.033061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d76da-b3e7-4a91-bc12-6d5ce04ac2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:53.033799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d76da-b3e7-4a91-bc12-6d5ce04ac2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:53.034080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d76da-b3e7-4a91-bc12-6d5ce04ac2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:53.034354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d76da-b3e7-4a91-bc12-6d5ce04ac2d4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:53.035529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d76da-b3e7-4a91-bc12-6d5ce04ac2d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:53.037215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d76da-b3e7-4a91-bc12-6d5ce04ac2d4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:53.037326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0865c-aea1-4735-baa4-080575db3985 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:53.038741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 11/19] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:27:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:27:53.042320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b6333-9e56-4479-a6c3-3a298aa0957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:53.042949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b6333-9e56-4479-a6c3-3a298aa0957d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:53.043235 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b6333-9e56-4479-a6c3-3a298aa0957d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:53.043515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b6333-9e56-4479-a6c3-3a298aa0957d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:53.044394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b6333-9e56-4479-a6c3-3a298aa0957d admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.domain.id=default, user.id=e0df9a34c2c246f2a37da6d5472f7d68) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:27:53.044715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b6333-9e56-4479-a6c3-3a298aa0957d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:53.046519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-862b6333-9e56-4479-a6c3-3a298aa0957d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:27:53.046519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:27:53.046519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:27:53.047699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b6333-9e56-4479-a6c3-3a298aa0957d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:53.058825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 9/20] 10.222.0.15 () {56 vars in 1343 bytes} [Mon Feb 7 02:27:53 2022] GET /identity/v3/role_assignments?user.id=e0df9a34c2c246f2a37da6d5472f7d68&scope.domain.id=default&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:27:55.768599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2d4ab-026b-4f5d-b0f4-3b8f914797b5 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:55.769582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2d4ab-026b-4f5d-b0f4-3b8f914797b5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:55.770061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2d4ab-026b-4f5d-b0f4-3b8f914797b5 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:55.772535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 12/21] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:27:55.785199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21667e6-ec07-4bad-bff8-64b7e9a0802f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:55.786195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21667e6-ec07-4bad-bff8-64b7e9a0802f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:55.786679 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21667e6-ec07-4bad-bff8-64b7e9a0802f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:55.813011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b21667e6-ec07-4bad-bff8-64b7e9a0802f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:55.814566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b21667e6-ec07-4bad-bff8-64b7e9a0802f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:55.832060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 10/22] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:27:55.867658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2d4ab-026b-4f5d-b0f4-3b8f914797b5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:55.886642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2d4ab-026b-4f5d-b0f4-3b8f914797b5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:55.891433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736857c2-f2ce-47d7-8b91-b8b211129f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:55.892500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736857c2-f2ce-47d7-8b91-b8b211129f41 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:55.892976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736857c2-f2ce-47d7-8b91-b8b211129f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:55.893466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736857c2-f2ce-47d7-8b91-b8b211129f41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:55.909793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736857c2-f2ce-47d7-8b91-b8b211129f41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:55.912014 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736857c2-f2ce-47d7-8b91-b8b211129f41 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:55.933526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-736857c2-f2ce-47d7-8b91-b8b211129f41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:27:55.935008 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 13/23] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:27:55.940921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21667e6-ec07-4bad-bff8-64b7e9a0802f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:55.950419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21667e6-ec07-4bad-bff8-64b7e9a0802f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:55.959927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00636d-8472-4369-a638-fd225ca86bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:55.960859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00636d-8472-4369-a638-fd225ca86bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:55.961341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00636d-8472-4369-a638-fd225ca86bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:55.961883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00636d-8472-4369-a638-fd225ca86bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:55.962819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00636d-8472-4369-a638-fd225ca86bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:27:55.963318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00636d-8472-4369-a638-fd225ca86bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:55.964553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-ca00636d-8472-4369-a638-fd225ca86bc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:27:55.964553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:27:55.964553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:27:55.965822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00636d-8472-4369-a638-fd225ca86bc1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:55.989109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 11/24] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:55.994824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736857c2-f2ce-47d7-8b91-b8b211129f41 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:56.005179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736857c2-f2ce-47d7-8b91-b8b211129f41 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:56.011969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a984f1-df2a-430c-98bf-f24042f0cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:56.012978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a984f1-df2a-430c-98bf-f24042f0cfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.013459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a984f1-df2a-430c-98bf-f24042f0cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.013931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a984f1-df2a-430c-98bf-f24042f0cfb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.014869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a984f1-df2a-430c-98bf-f24042f0cfb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:56.016091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-91a984f1-df2a-430c-98bf-f24042f0cfb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:27:56.016091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:27:56.016091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:27:56.017676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a984f1-df2a-430c-98bf-f24042f0cfb4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:56.052860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce410842-996b-4199-9150-4c6ff474ea1e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.053368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce410842-996b-4199-9150-4c6ff474ea1e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.053785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce410842-996b-4199-9150-4c6ff474ea1e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.057015 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 12/25] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:27:56.062433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e829-e24e-48b3-9b72-23d69d71f013 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.062956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e829-e24e-48b3-9b72-23d69d71f013 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.063478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91e829-e24e-48b3-9b72-23d69d71f013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.082905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2a91e829-e24e-48b3-9b72-23d69d71f013 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:56.084530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2a91e829-e24e-48b3-9b72-23d69d71f013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:56.092752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 13/26] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:27:56.115766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e829-e24e-48b3-9b72-23d69d71f013 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:56.129981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91e829-e24e-48b3-9b72-23d69d71f013 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:56.142335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ba1b9-27c3-4e58-bc84-18e537c64654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:56.143273 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ba1b9-27c3-4e58-bc84-18e537c64654 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.143749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ba1b9-27c3-4e58-bc84-18e537c64654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.144214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ba1b9-27c3-4e58-bc84-18e537c64654 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.145187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ba1b9-27c3-4e58-bc84-18e537c64654 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:56.146381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-b32ba1b9-27c3-4e58-bc84-18e537c64654 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:27:56.146381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:27:56.146381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:27:56.147609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ba1b9-27c3-4e58-bc84-18e537c64654 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:56.181675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 14/27] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:27:55 2022] POST /identity/v3/projects => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:27:56.183843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a41c-e5d9-425c-9c9f-71422b657446 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.184421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a41c-e5d9-425c-9c9f-71422b657446 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.184966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451a41c-e5d9-425c-9c9f-71422b657446 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.187212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 15/28] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:27:56.214312 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dead8-15c1-4a91-8eda-b1d2401a70e6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.214882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dead8-15c1-4a91-8eda-b1d2401a70e6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.215372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6dead8-15c1-4a91-8eda-b1d2401a70e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.253609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8e6dead8-15c1-4a91-8eda-b1d2401a70e6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:56.255542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8e6dead8-15c1-4a91-8eda-b1d2401a70e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:56.349492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 14/29] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:27:56 2022] POST /identity/v3/roles => generated 225 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:27:56.352713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5f482-ef6a-4cc9-8f30-9551340a7eb0 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.353009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5f482-ef6a-4cc9-8f30-9551340a7eb0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.353294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5f482-ef6a-4cc9-8f30-9551340a7eb0 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.355151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 15/30] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:27:56.361798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c785a9e-852b-4f43-ac56-fa1d8364311a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.362102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c785a9e-852b-4f43-ac56-fa1d8364311a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.363046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c785a9e-852b-4f43-ac56-fa1d8364311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.376592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 16/31] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:27:56.391971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4c785a9e-852b-4f43-ac56-fa1d8364311a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:56.393611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4c785a9e-852b-4f43-ac56-fa1d8364311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:56.406567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 16/32] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:27:56.417075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dead8-15c1-4a91-8eda-b1d2401a70e6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:56.429811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6dead8-15c1-4a91-8eda-b1d2401a70e6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:56.439684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e8354-56e2-4f91-9d69-fdd677180cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:56.440303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e8354-56e2-4f91-9d69-fdd677180cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.440510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c785a9e-852b-4f43-ac56-fa1d8364311a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:56.440664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e8354-56e2-4f91-9d69-fdd677180cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.440909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e8354-56e2-4f91-9d69-fdd677180cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.441731 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e8354-56e2-4f91-9d69-fdd677180cd8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:56.442963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-5b9e8354-56e2-4f91-9d69-fdd677180cd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:27:56.442963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:27:56.442963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:27:56.443885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e8354-56e2-4f91-9d69-fdd677180cd8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:56.454412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c785a9e-852b-4f43-ac56-fa1d8364311a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:56.460128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc89466-80bc-4987-af1d-5e745a613e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:56.461499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc89466-80bc-4987-af1d-5e745a613e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.465216 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc89466-80bc-4987-af1d-5e745a613e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.467137 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc89466-80bc-4987-af1d-5e745a613e13 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.473674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 17/33] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:27:56 2022] POST /identity/v3/roles => generated 219 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:27:56.490370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc89466-80bc-4987-af1d-5e745a613e13 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:27:56.498751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6cc89466-80bc-4987-af1d-5e745a613e13 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:27:56.500541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 17/34] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:27:56.511647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e8354-56e2-4f91-9d69-fdd677180cd8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:56.523234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e8354-56e2-4f91-9d69-fdd677180cd8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:56.529984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad78c-038a-41cf-ac95-4dff3c20706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:56.531109 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad78c-038a-41cf-ac95-4dff3c20706b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.531597 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad78c-038a-41cf-ac95-4dff3c20706b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.532074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ad78c-038a-41cf-ac95-4dff3c20706b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.533253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad78c-038a-41cf-ac95-4dff3c20706b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:27:56.533767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad78c-038a-41cf-ac95-4dff3c20706b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:56.537568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ad78c-038a-41cf-ac95-4dff3c20706b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:56.548873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 18/35] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:56.554934 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc89466-80bc-4987-af1d-5e745a613e13 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:56.566819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc89466-80bc-4987-af1d-5e745a613e13 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:56.577386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3092dc5-c542-48e0-b480-fe901ee1c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:56.578286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3092dc5-c542-48e0-b480-fe901ee1c2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.578567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3092dc5-c542-48e0-b480-fe901ee1c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.578845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3092dc5-c542-48e0-b480-fe901ee1c2fa admin admin] PATH_INFO: `/v3/users/e0df9a34c2c246f2a37da6d5472f7d68` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.580147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3092dc5-c542-48e0-b480-fe901ee1c2fa admin admin] RBAC: Authorizing `identity:get_user(user_id=e0df9a34c2c246f2a37da6d5472f7d68)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:56.582157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3092dc5-c542-48e0-b480-fe901ee1c2fa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:56.583833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 18/36] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:27:56 2022] GET /identity/v3/users/e0df9a34c2c246f2a37da6d5472f7d68 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:56.589446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad78c-038a-41cf-ac95-4dff3c20706b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:56.605142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ad78c-038a-41cf-ac95-4dff3c20706b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:56.613224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6799b-2f80-4bc8-9385-2b4845d6478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:56.614432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6799b-2f80-4bc8-9385-2b4845d6478d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.614939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6799b-2f80-4bc8-9385-2b4845d6478d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.615419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6799b-2f80-4bc8-9385-2b4845d6478d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.621379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6799b-2f80-4bc8-9385-2b4845d6478d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:56.623565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6799b-2f80-4bc8-9385-2b4845d6478d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:56.625616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 19/37] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:27:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:56.633705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3092dc5-c542-48e0-b480-fe901ee1c2fa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:56.646185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3092dc5-c542-48e0-b480-fe901ee1c2fa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:56.651120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4014a7c-e68e-4163-92da-020e644b8c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:56.652009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4014a7c-e68e-4163-92da-020e644b8c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.652279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4014a7c-e68e-4163-92da-020e644b8c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.652587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4014a7c-e68e-4163-92da-020e644b8c11 admin admin] PATH_INFO: `/v3/domains/default/users/e0df9a34c2c246f2a37da6d5472f7d68/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.657026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4014a7c-e68e-4163-92da-020e644b8c11 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e0df9a34c2c246f2a37da6d5472f7d68, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:56.658181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-f4014a7c-e68e-4163-92da-020e644b8c11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:27:56.658181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:27:56.658181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:27:56.660175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4014a7c-e68e-4163-92da-020e644b8c11 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:56.687495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 19/38] 10.222.0.15 () {58 vars in 1382 bytes} [Mon Feb 7 02:27:56 2022] PUT /identity/v3/domains/default/users/e0df9a34c2c246f2a37da6d5472f7d68/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:27:56.800172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eca9b-5122-45b8-8550-526c8157c286 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.801263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eca9b-5122-45b8-8550-526c8157c286 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.801767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eca9b-5122-45b8-8550-526c8157c286 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.803938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 20/39] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:27:56.810545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb677-6dfa-488d-adbe-960b46c61940 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.811035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb677-6dfa-488d-adbe-960b46c61940 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.811135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb677-6dfa-488d-adbe-960b46c61940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.831417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7f8fb677-6dfa-488d-adbe-960b46c61940 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:56.832688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7f8fb677-6dfa-488d-adbe-960b46c61940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:56.920211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 20/40] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:27:56.942524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eca9b-5122-45b8-8550-526c8157c286 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:56.954786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eca9b-5122-45b8-8550-526c8157c286 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:56.958996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894efbc-a956-4313-8d98-02f1abd5cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:56.959651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894efbc-a956-4313-8d98-02f1abd5cb67 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:56.959929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894efbc-a956-4313-8d98-02f1abd5cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:56.960201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894efbc-a956-4313-8d98-02f1abd5cb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:56.960995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894efbc-a956-4313-8d98-02f1abd5cb67 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:56.963157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894efbc-a956-4313-8d98-02f1abd5cb67 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:56.978179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 21/41] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:27:56 2022] POST /identity/v3/roles => generated 223 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:27:57.653757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512169a0-8e09-4cc7-aefb-114b9a756d09 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:57.654167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512169a0-8e09-4cc7-aefb-114b9a756d09 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:57.654534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512169a0-8e09-4cc7-aefb-114b9a756d09 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:57.656429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 21/42] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:27:57.661740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e83d-2187-4d91-be58-f4cb174b004b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:57.662097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e83d-2187-4d91-be58-f4cb174b004b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:57.662444 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e83d-2187-4d91-be58-f4cb174b004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:57.680719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-41d0e83d-2187-4d91-be58-f4cb174b004b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:57.681905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-41d0e83d-2187-4d91-be58-f4cb174b004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:57.689416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:27:57.713501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512169a0-8e09-4cc7-aefb-114b9a756d09 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:57.725781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512169a0-8e09-4cc7-aefb-114b9a756d09 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:57.730741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1cd55-0665-434d-a6e2-952fcec79d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:57.731526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1cd55-0665-434d-a6e2-952fcec79d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:57.731811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1cd55-0665-434d-a6e2-952fcec79d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:57.732089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1cd55-0665-434d-a6e2-952fcec79d39 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:57.733326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1cd55-0665-434d-a6e2-952fcec79d39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:57.735056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1cd55-0665-434d-a6e2-952fcec79d39 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:57.736694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 22/44] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:57.742294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0e83d-2187-4d91-be58-f4cb174b004b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:57.751358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0e83d-2187-4d91-be58-f4cb174b004b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:57.755704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5f6a5-6fe7-4176-aaf4-a1099cd1e6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:57.756358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f6a5-6fe7-4176-aaf4-a1099cd1e6ab admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:57.756651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f6a5-6fe7-4176-aaf4-a1099cd1e6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:57.756922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5f6a5-6fe7-4176-aaf4-a1099cd1e6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:57.757641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5f6a5-6fe7-4176-aaf4-a1099cd1e6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:57.759561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5f6a5-6fe7-4176-aaf4-a1099cd1e6ab admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:57.784151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:27:57 2022] POST /identity/v3/projects => generated 312 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:27:58.917283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86998b4-eca9-440e-a73a-7c462c746a88 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:58.917806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86998b4-eca9-440e-a73a-7c462c746a88 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:58.917912 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86998b4-eca9-440e-a73a-7c462c746a88 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:58.919982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 23/46] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:27:58.925743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2bb22-ac38-4ed3-a8f3-ac24330b92ac None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:58.926183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2bb22-ac38-4ed3-a8f3-ac24330b92ac None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:58.926357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2bb22-ac38-4ed3-a8f3-ac24330b92ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:58.944973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-03e2bb22-ac38-4ed3-a8f3-ac24330b92ac None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:27:58.946446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-03e2bb22-ac38-4ed3-a8f3-ac24330b92ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:27:59.011751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 24/47] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:27:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:27:59.034607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86998b4-eca9-440e-a73a-7c462c746a88 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:59.047870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86998b4-eca9-440e-a73a-7c462c746a88 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:59.052398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf415c89-b867-4f1d-884f-9977b2f89aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:59.053265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf415c89-b867-4f1d-884f-9977b2f89aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:59.053678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf415c89-b867-4f1d-884f-9977b2f89aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:59.054023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf415c89-b867-4f1d-884f-9977b2f89aa8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:59.065114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf415c89-b867-4f1d-884f-9977b2f89aa8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:27:59.071922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-bf415c89-b867-4f1d-884f-9977b2f89aa8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:27:59.077922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 24/48] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:27:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:27:59.079503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2bb22-ac38-4ed3-a8f3-ac24330b92ac None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:59.088699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2bb22-ac38-4ed3-a8f3-ac24330b92ac None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:59.093843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c91bd5-0f90-4588-92d2-e1c8db9c2c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:59.094513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c91bd5-0f90-4588-92d2-e1c8db9c2c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:59.094798 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c91bd5-0f90-4588-92d2-e1c8db9c2c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:59.095074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c91bd5-0f90-4588-92d2-e1c8db9c2c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:59.095833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c91bd5-0f90-4588-92d2-e1c8db9c2c30 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:27:59.096138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c91bd5-0f90-4588-92d2-e1c8db9c2c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:59.097801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c91bd5-0f90-4588-92d2-e1c8db9c2c30 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:59.107133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 25/49] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:27:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:59.112279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf415c89-b867-4f1d-884f-9977b2f89aa8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:59.123154 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf415c89-b867-4f1d-884f-9977b2f89aa8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:59.127931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e8d0f-f0bd-48f0-a085-47aa7f1dafc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:59.128818 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e8d0f-f0bd-48f0-a085-47aa7f1dafc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:59.129103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e8d0f-f0bd-48f0-a085-47aa7f1dafc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:59.129378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e8d0f-f0bd-48f0-a085-47aa7f1dafc6 admin admin] PATH_INFO: `/v3/users/e0df9a34c2c246f2a37da6d5472f7d68` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:59.130599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e8d0f-f0bd-48f0-a085-47aa7f1dafc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0df9a34c2c246f2a37da6d5472f7d68)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:59.132477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e8d0f-f0bd-48f0-a085-47aa7f1dafc6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:59.136630 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 25/50] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:27:59 2022] GET /identity/v3/users/e0df9a34c2c246f2a37da6d5472f7d68 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:59.139151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c91bd5-0f90-4588-92d2-e1c8db9c2c30 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:59.148727 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c91bd5-0f90-4588-92d2-e1c8db9c2c30 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:59.153089 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff5075-c1f8-48c3-ab57-71a3775feb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:59.153860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff5075-c1f8-48c3-ab57-71a3775feb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:59.154156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff5075-c1f8-48c3-ab57-71a3775feb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:59.154420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff5075-c1f8-48c3-ab57-71a3775feb94 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:59.155598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff5075-c1f8-48c3-ab57-71a3775feb94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:59.157330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff5075-c1f8-48c3-ab57-71a3775feb94 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:59.158878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 26/51] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:27:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:27:59.164046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e8d0f-f0bd-48f0-a085-47aa7f1dafc6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:27:59.174139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e8d0f-f0bd-48f0-a085-47aa7f1dafc6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:27:59.178448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c9ded-51ec-4a0b-a00d-c9af0cfce1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:27:59.179075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c9ded-51ec-4a0b-a00d-c9af0cfce1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:27:59.179362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c9ded-51ec-4a0b-a00d-c9af0cfce1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:27:59.179639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c9ded-51ec-4a0b-a00d-c9af0cfce1e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:27:59.181158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c9ded-51ec-4a0b-a00d-c9af0cfce1e8 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.domain.id=default, user.id=e0df9a34c2c246f2a37da6d5472f7d68) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:27:59.181474 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c9ded-51ec-4a0b-a00d-c9af0cfce1e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:27:59.183328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c9ded-51ec-4a0b-a00d-c9af0cfce1e8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:27:59.188949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 26/52] 10.222.0.15 () {56 vars in 1343 bytes} [Mon Feb 7 02:27:59 2022] GET /identity/v3/role_assignments?user.id=e0df9a34c2c246f2a37da6d5472f7d68&scope.domain.id=default&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:00.020717 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08986-941f-4313-a7d0-5d3757affd81 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:00.021187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08986-941f-4313-a7d0-5d3757affd81 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:00.021187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08986-941f-4313-a7d0-5d3757affd81 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:00.022991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 27/53] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:00.028437 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218d1d-cc6e-4cde-b696-1bcf07a7e671 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:00.028973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218d1d-cc6e-4cde-b696-1bcf07a7e671 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:00.028973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22218d1d-cc6e-4cde-b696-1bcf07a7e671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:00.046210 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-22218d1d-cc6e-4cde-b696-1bcf07a7e671 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:00.047382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-22218d1d-cc6e-4cde-b696-1bcf07a7e671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:00.054776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 27/54] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:00.079028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08986-941f-4313-a7d0-5d3757affd81 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:00.090794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08986-941f-4313-a7d0-5d3757affd81 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:00.094919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4893ae-dff3-4483-84b1-da210f7c50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:00.095676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4893ae-dff3-4483-84b1-da210f7c50e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:00.095956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4893ae-dff3-4483-84b1-da210f7c50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:00.096227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4893ae-dff3-4483-84b1-da210f7c50e6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:00.097447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4893ae-dff3-4483-84b1-da210f7c50e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:00.099123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4893ae-dff3-4483-84b1-da210f7c50e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:00.100697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:00.105759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22218d1d-cc6e-4cde-b696-1bcf07a7e671 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:00.114351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22218d1d-cc6e-4cde-b696-1bcf07a7e671 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:00.119152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cc902-9d69-408b-8800-3cf9072efaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:00.119787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cc902-9d69-408b-8800-3cf9072efaf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:00.120071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cc902-9d69-408b-8800-3cf9072efaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:00.120362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cc902-9d69-408b-8800-3cf9072efaf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:00.121102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cc902-9d69-408b-8800-3cf9072efaf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:00.122114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-cd8cc902-9d69-408b-8800-3cf9072efaf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:00.122114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:28:00.122114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:28:00.123306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cc902-9d69-408b-8800-3cf9072efaf5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:00.148949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 28/56] 10.222.0.15 () {60 vars in 1161 bytes} [Mon Feb 7 02:28:00 2022] POST /identity/v3/projects => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:28:02.340401 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc5e56-466b-499b-b25f-4ef99c3512be None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:02.340909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc5e56-466b-499b-b25f-4ef99c3512be None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:02.341013 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc5e56-466b-499b-b25f-4ef99c3512be None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:02.342717 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 29/57] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:02.347866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a32261-ca83-40a4-9b21-f23f62e536f5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:02.348266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a32261-ca83-40a4-9b21-f23f62e536f5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:02.348449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a32261-ca83-40a4-9b21-f23f62e536f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:02.366430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f1a32261-ca83-40a4-9b21-f23f62e536f5 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:02.367660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f1a32261-ca83-40a4-9b21-f23f62e536f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:02.421798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 29/58] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:02.445359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc5e56-466b-499b-b25f-4ef99c3512be None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:02.457245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc5e56-466b-499b-b25f-4ef99c3512be None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:02.461834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda67bb-e158-4503-afde-11c7815e3ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:02.462589 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda67bb-e158-4503-afde-11c7815e3ccc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:02.462867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda67bb-e158-4503-afde-11c7815e3ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:02.463135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda67bb-e158-4503-afde-11c7815e3ccc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:02.464297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda67bb-e158-4503-afde-11c7815e3ccc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:02.466000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda67bb-e158-4503-afde-11c7815e3ccc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:02.467531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 30/59] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:02.472390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a32261-ca83-40a4-9b21-f23f62e536f5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:02.481653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a32261-ca83-40a4-9b21-f23f62e536f5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:02.485991 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b96f3-33ae-4b47-987d-3eaeac8a2e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:02.486632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b96f3-33ae-4b47-987d-3eaeac8a2e46 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:02.486917 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b96f3-33ae-4b47-987d-3eaeac8a2e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:02.487196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b96f3-33ae-4b47-987d-3eaeac8a2e46 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:02.487907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b96f3-33ae-4b47-987d-3eaeac8a2e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:02.488959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-5f2b96f3-33ae-4b47-987d-3eaeac8a2e46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:02.488959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:28:02.488959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:28:02.490182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b96f3-33ae-4b47-987d-3eaeac8a2e46 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:02.514161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 30/60] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:02 2022] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:05.954763 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7116-bb57-42ee-9814-1c5182dfd015 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:05.955673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7116-bb57-42ee-9814-1c5182dfd015 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:05.956134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d7116-bb57-42ee-9814-1c5182dfd015 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:05.958127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 31/61] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:05.973191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7934-fd81-4da7-8f5c-abf7da20d462 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:05.974077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7934-fd81-4da7-8f5c-abf7da20d462 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:05.974545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb7934-fd81-4da7-8f5c-abf7da20d462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:05.987222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550e365-94f9-4ea9-a9c1-cf9a100f022e None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:05.987875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550e365-94f9-4ea9-a9c1-cf9a100f022e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:05.988422 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550e365-94f9-4ea9-a9c1-cf9a100f022e None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:05.991508 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 32/62] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:05.998842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c31ef9-ce6b-4e55-a54a-14b57def660e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:05.999474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c31ef9-ce6b-4e55-a54a-14b57def660e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:05.999963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c31ef9-ce6b-4e55-a54a-14b57def660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.000988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0acb7934-fd81-4da7-8f5c-abf7da20d462 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:06.002251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0acb7934-fd81-4da7-8f5c-abf7da20d462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:06.021535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 31/63] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:06.034936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-61c31ef9-ce6b-4e55-a54a-14b57def660e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:06.036140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-61c31ef9-ce6b-4e55-a54a-14b57def660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:06.047213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb7934-fd81-4da7-8f5c-abf7da20d462 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.048675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 33/64] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:06.064364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb7934-fd81-4da7-8f5c-abf7da20d462 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.069401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d4e61-c62f-4884-99bf-57c6b94865e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.070417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d4e61-c62f-4884-99bf-57c6b94865e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.071481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d4e61-c62f-4884-99bf-57c6b94865e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.071970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d4e61-c62f-4884-99bf-57c6b94865e3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.088254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d4e61-c62f-4884-99bf-57c6b94865e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:06.095731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-9f9d4e61-c62f-4884-99bf-57c6b94865e3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:28:06.097651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 32/65] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:06.103782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c31ef9-ce6b-4e55-a54a-14b57def660e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.110571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d4e61-c62f-4884-99bf-57c6b94865e3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.126611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d4e61-c62f-4884-99bf-57c6b94865e3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.127673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c31ef9-ce6b-4e55-a54a-14b57def660e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.136317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ac186-6444-4c53-ba25-ab0b2d66f4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.137946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ac186-6444-4c53-ba25-ab0b2d66f4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.138725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ebfe2-2f87-4bc2-adac-2c41b53bde23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.139611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ebfe2-2f87-4bc2-adac-2c41b53bde23 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.140104 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ac186-6444-4c53-ba25-ab0b2d66f4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.140625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ac186-6444-4c53-ba25-ab0b2d66f4d9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.141255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ebfe2-2f87-4bc2-adac-2c41b53bde23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.142227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ebfe2-2f87-4bc2-adac-2c41b53bde23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.143217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ebfe2-2f87-4bc2-adac-2c41b53bde23 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:06.143910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ebfe2-2f87-4bc2-adac-2c41b53bde23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.147192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ebfe2-2f87-4bc2-adac-2c41b53bde23 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.160740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 34/66] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.166575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ebfe2-2f87-4bc2-adac-2c41b53bde23 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.177113 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ebfe2-2f87-4bc2-adac-2c41b53bde23 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.177300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ac186-6444-4c53-ba25-ab0b2d66f4d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:06.182547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941729bc-89c3-4ef3-8c75-1b7e365f015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.183671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941729bc-89c3-4ef3-8c75-1b7e365f015c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.184159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941729bc-89c3-4ef3-8c75-1b7e365f015c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.184662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941729bc-89c3-4ef3-8c75-1b7e365f015c admin admin] PATH_INFO: `/v3/users/e0df9a34c2c246f2a37da6d5472f7d68` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.184964 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-140ac186-6444-4c53-ba25-ab0b2d66f4d9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:06.186179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 33/67] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:06.186607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941729bc-89c3-4ef3-8c75-1b7e365f015c admin admin] RBAC: Authorizing `identity:get_user(user_id=e0df9a34c2c246f2a37da6d5472f7d68)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.188735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941729bc-89c3-4ef3-8c75-1b7e365f015c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.190832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 35/68] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/users/e0df9a34c2c246f2a37da6d5472f7d68 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:06.194694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ac186-6444-4c53-ba25-ab0b2d66f4d9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.197110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941729bc-89c3-4ef3-8c75-1b7e365f015c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.208455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941729bc-89c3-4ef3-8c75-1b7e365f015c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.213333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e39b7-9ba2-45b2-b3b4-ffd99a9fd7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.214211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e39b7-9ba2-45b2-b3b4-ffd99a9fd7da admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.214461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ac186-6444-4c53-ba25-ab0b2d66f4d9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.214910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e39b7-9ba2-45b2-b3b4-ffd99a9fd7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.215474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e39b7-9ba2-45b2-b3b4-ffd99a9fd7da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.224923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e39b7-9ba2-45b2-b3b4-ffd99a9fd7da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.227017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e39b7-9ba2-45b2-b3b4-ffd99a9fd7da admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.229098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.229790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.230078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.230354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.231131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:06.231440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.232473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:06.232473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:28:06.232473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:28:06.233384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.239407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 36/69] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 02:28:06.246478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e39b7-9ba2-45b2-b3b4-ffd99a9fd7da admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.255788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 34/70] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.256947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e39b7-9ba2-45b2-b3b4-ffd99a9fd7da admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.262388 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.263648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b88fc6-90da-42dd-a99b-8c82113b7978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.265141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b88fc6-90da-42dd-a99b-8c82113b7978 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.266024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b88fc6-90da-42dd-a99b-8c82113b7978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.270673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b88fc6-90da-42dd-a99b-8c82113b7978 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.272146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b88fc6-90da-42dd-a99b-8c82113b7978 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.274491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b88fc6-90da-42dd-a99b-8c82113b7978 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.278119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 37/71] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:06.281669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb04fd3-cb60-4b8a-b6f1-65374c96006a None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.281955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb04fd3-cb60-4b8a-b6f1-65374c96006a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.282297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb04fd3-cb60-4b8a-b6f1-65374c96006a None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.282637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f44fdc-821b-4b9f-bd05-8f5f6d611c7d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.284220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 38/72] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:06.287647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede755d-2d02-4241-8ccc-63e3dbc82d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.288824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede755d-2d02-4241-8ccc-63e3dbc82d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.289285 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede755d-2d02-4241-8ccc-63e3dbc82d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.289732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede755d-2d02-4241-8ccc-63e3dbc82d88 admin admin] PATH_INFO: `/v3/users/21518ca41ca445508b5bcedf5b9db8f6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.289997 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb605a8-46e3-43d1-8853-602fdb0d2e33 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.290286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb605a8-46e3-43d1-8853-602fdb0d2e33 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.290565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb605a8-46e3-43d1-8853-602fdb0d2e33 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.292331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 39/73] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:06.293275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a532efd-578a-4d42-b8e2-824ca509cbc2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.293555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a532efd-578a-4d42-b8e2-824ca509cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.293828 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a532efd-578a-4d42-b8e2-824ca509cbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.307565 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede755d-2d02-4241-8ccc-63e3dbc82d88 admin admin] RBAC: Authorizing `identity:get_user(user_id=21518ca41ca445508b5bcedf5b9db8f6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.309985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede755d-2d02-4241-8ccc-63e3dbc82d88 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.311529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8a532efd-578a-4d42-b8e2-824ca509cbc2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:06.311707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 35/74] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/users/21518ca41ca445508b5bcedf5b9db8f6 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:06.312463 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede755d-2d02-4241-8ccc-63e3dbc82d88 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.312754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8a532efd-578a-4d42-b8e2-824ca509cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:06.322809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 40/75] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:06.324091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5423d7-3cdd-4f88-a3d7-7187e8970399 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.324458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5423d7-3cdd-4f88-a3d7-7187e8970399 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.324737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5423d7-3cdd-4f88-a3d7-7187e8970399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.326878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede755d-2d02-4241-8ccc-63e3dbc82d88 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.331548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af652b-295a-4cc9-997c-d33a1d9c2fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.332460 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af652b-295a-4cc9-997c-d33a1d9c2fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.332962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af652b-295a-4cc9-997c-d33a1d9c2fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.333439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af652b-295a-4cc9-997c-d33a1d9c2fe5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.334506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af652b-295a-4cc9-997c-d33a1d9c2fe5 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09, user.id=e0df9a34c2c246f2a37da6d5472f7d68) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:06.335020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af652b-295a-4cc9-997c-d33a1d9c2fe5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.337237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af652b-295a-4cc9-997c-d33a1d9c2fe5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.342505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1f5423d7-3cdd-4f88-a3d7-7187e8970399 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:06.343631 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 36/76] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/role_assignments?user.id=e0df9a34c2c246f2a37da6d5472f7d68&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.343749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1f5423d7-3cdd-4f88-a3d7-7187e8970399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:06.344931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af652b-295a-4cc9-997c-d33a1d9c2fe5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.351453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 41/77] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:06.355709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af652b-295a-4cc9-997c-d33a1d9c2fe5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.359424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5423d7-3cdd-4f88-a3d7-7187e8970399 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.360721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152ff16-b667-4cc9-a23a-fda8cf4ec509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.361496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152ff16-b667-4cc9-a23a-fda8cf4ec509 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.361887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152ff16-b667-4cc9-a23a-fda8cf4ec509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.362271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152ff16-b667-4cc9-a23a-fda8cf4ec509 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.370856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5423d7-3cdd-4f88-a3d7-7187e8970399 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.371518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152ff16-b667-4cc9-a23a-fda8cf4ec509 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.373476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152ff16-b667-4cc9-a23a-fda8cf4ec509 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.376042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a720b96-5f48-4c55-b632-132c1172b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.376894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720b96-5f48-4c55-b632-132c1172b8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.377174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720b96-5f48-4c55-b632-132c1172b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.377447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720b96-5f48-4c55-b632-132c1172b8d7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.383554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 37/78] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:06.384963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f3b7-bb9b-4e22-b2b6-8f4b54ee1eaa None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.385259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f3b7-bb9b-4e22-b2b6-8f4b54ee1eaa None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.385541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2f3b7-bb9b-4e22-b2b6-8f4b54ee1eaa None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.387665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 38/79] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:06.389820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a720b96-5f48-4c55-b632-132c1172b8d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:06.393047 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f3b7-bb9b-4e22-b2b6-8f4b54ee1eaa None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.397127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-9a720b96-5f48-4c55-b632-132c1172b8d7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:06.398395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 42/80] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:06.399701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41265de5-39c7-48e2-a288-eb3d35ecc59c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.399986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41265de5-39c7-48e2-a288-eb3d35ecc59c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.400264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41265de5-39c7-48e2-a288-eb3d35ecc59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.406280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2f3b7-bb9b-4e22-b2b6-8f4b54ee1eaa None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.410922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cc3b9-6c5e-42df-914a-ff7bc08065fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.411793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cc3b9-6c5e-42df-914a-ff7bc08065fc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.412079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cc3b9-6c5e-42df-914a-ff7bc08065fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.412382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cc3b9-6c5e-42df-914a-ff7bc08065fc admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.413608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cc3b9-6c5e-42df-914a-ff7bc08065fc admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.416264 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cc3b9-6c5e-42df-914a-ff7bc08065fc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.418136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 39/81] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.419153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cc3b9-6c5e-42df-914a-ff7bc08065fc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.420363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-41265de5-39c7-48e2-a288-eb3d35ecc59c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:06.421775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-41265de5-39c7-48e2-a288-eb3d35ecc59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:06.429433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cc3b9-6c5e-42df-914a-ff7bc08065fc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.431172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 43/82] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:06.431785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41265de5-39c7-48e2-a288-eb3d35ecc59c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.442402 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41265de5-39c7-48e2-a288-eb3d35ecc59c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.447694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d432c6d-616a-4d5e-9a00-ffb620531693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.448542 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d432c6d-616a-4d5e-9a00-ffb620531693 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.448827 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d432c6d-616a-4d5e-9a00-ffb620531693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.449103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d432c6d-616a-4d5e-9a00-ffb620531693 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.451409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbb7b7-c8d1-4796-bb7d-1eb2504ea611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.452429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb7b7-c8d1-4796-bb7d-1eb2504ea611 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.452937 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb7b7-c8d1-4796-bb7d-1eb2504ea611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.453425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbb7b7-c8d1-4796-bb7d-1eb2504ea611 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.454425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbb7b7-c8d1-4796-bb7d-1eb2504ea611 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:06.454933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbb7b7-c8d1-4796-bb7d-1eb2504ea611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.456907 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbb7b7-c8d1-4796-bb7d-1eb2504ea611 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.461734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d432c6d-616a-4d5e-9a00-ffb620531693 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:06.465670 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 44/83] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.466342 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbb7b7-c8d1-4796-bb7d-1eb2504ea611 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.471866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0d432c6d-616a-4d5e-9a00-ffb620531693 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:06.474286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 40/84] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:06.474286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d432c6d-616a-4d5e-9a00-ffb620531693 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.479900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbb7b7-c8d1-4796-bb7d-1eb2504ea611 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.484621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.485043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d432c6d-616a-4d5e-9a00-ffb620531693 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.485284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.485568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.485846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.486693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] RBAC: Adding query filter params (role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09, user.id=21518ca41ca445508b5bcedf5b9db8f6) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:06.487005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.488045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:06.488045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:28:06.488045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:28:06.489267 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.489787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a18e4-36b7-425e-a81f-1594a12e0e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.490590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a18e4-36b7-425e-a81f-1594a12e0e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.490873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a18e4-36b7-425e-a81f-1594a12e0e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.491150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a18e4-36b7-425e-a81f-1594a12e0e13 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.492992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a18e4-36b7-425e-a81f-1594a12e0e13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.494738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a18e4-36b7-425e-a81f-1594a12e0e13 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.504049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 41/85] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.504049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a18e4-36b7-425e-a81f-1594a12e0e13 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.504334 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 45/86] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/role_assignments?user.id=21518ca41ca445508b5bcedf5b9db8f6&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.504334 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.509037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc662ee5-2c4b-4c0c-a949-8e7c4b69bf8b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.513886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca20e6-97b2-40c3-9d29-dec976522e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.514586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca20e6-97b2-40c3-9d29-dec976522e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.514868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca20e6-97b2-40c3-9d29-dec976522e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.515148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca20e6-97b2-40c3-9d29-dec976522e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.515948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca20e6-97b2-40c3-9d29-dec976522e95 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:06.516259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca20e6-97b2-40c3-9d29-dec976522e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.517233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a18e4-36b7-425e-a81f-1594a12e0e13 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.518023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca20e6-97b2-40c3-9d29-dec976522e95 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.522317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba45db-0207-4f8c-9fc9-ed853b5d8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.523490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba45db-0207-4f8c-9fc9-ed853b5d8735 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.523947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba45db-0207-4f8c-9fc9-ed853b5d8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.524400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba45db-0207-4f8c-9fc9-ed853b5d8735 admin admin] PATH_INFO: `/v3/users/21518ca41ca445508b5bcedf5b9db8f6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.525881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba45db-0207-4f8c-9fc9-ed853b5d8735 admin admin] RBAC: Authorizing `identity:get_user(user_id=21518ca41ca445508b5bcedf5b9db8f6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.528675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 46/87] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.529248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba45db-0207-4f8c-9fc9-ed853b5d8735 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.529505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca20e6-97b2-40c3-9d29-dec976522e95 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.531628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 42/88] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/users/21518ca41ca445508b5bcedf5b9db8f6 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.541383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba45db-0207-4f8c-9fc9-ed853b5d8735 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.541988 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca20e6-97b2-40c3-9d29-dec976522e95 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.546939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba0351-90b5-4c6a-acbe-3328978d3820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.547635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba0351-90b5-4c6a-acbe-3328978d3820 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.547918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba0351-90b5-4c6a-acbe-3328978d3820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.548196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba0351-90b5-4c6a-acbe-3328978d3820 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.549002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba0351-90b5-4c6a-acbe-3328978d3820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.550071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-52ba0351-90b5-4c6a-acbe-3328978d3820 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:06.550071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:28:06.550071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:28:06.551301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba0351-90b5-4c6a-acbe-3328978d3820 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.567075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba45db-0207-4f8c-9fc9-ed853b5d8735 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.572706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828c964-df66-467f-a3e5-ce5866986dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.573495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828c964-df66-467f-a3e5-ce5866986dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.573856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828c964-df66-467f-a3e5-ce5866986dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.574207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828c964-df66-467f-a3e5-ce5866986dc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.582422 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 47/89] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:06 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:06.583659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba0351-90b5-4c6a-acbe-3328978d3820 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.590563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828c964-df66-467f-a3e5-ce5866986dc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.592660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828c964-df66-467f-a3e5-ce5866986dc2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.595743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba0351-90b5-4c6a-acbe-3328978d3820 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.601145 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7321a-3cae-4084-9996-5580028ca40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.603147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7321a-3cae-4084-9996-5580028ca40d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.603728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7321a-3cae-4084-9996-5580028ca40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.604236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7321a-3cae-4084-9996-5580028ca40d admin admin] PATH_INFO: `/v3/users/21518ca41ca445508b5bcedf5b9db8f6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.605981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7321a-3cae-4084-9996-5580028ca40d admin admin] RBAC: Authorizing `identity:get_user(user_id=21518ca41ca445508b5bcedf5b9db8f6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.608855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7321a-3cae-4084-9996-5580028ca40d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.611141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 48/90] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/users/21518ca41ca445508b5bcedf5b9db8f6 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.611827 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 43/91] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 02:28:06.618093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7321a-3cae-4084-9996-5580028ca40d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.618304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828c964-df66-467f-a3e5-ce5866986dc2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.629612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7321a-3cae-4084-9996-5580028ca40d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.634868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755a13-dc6a-48ea-9a7c-c517e62bb647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.635981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755a13-dc6a-48ea-9a7c-c517e62bb647 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.636576 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755a13-dc6a-48ea-9a7c-c517e62bb647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.637112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1755a13-dc6a-48ea-9a7c-c517e62bb647 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.643017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828c964-df66-467f-a3e5-ce5866986dc2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.647465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755a13-dc6a-48ea-9a7c-c517e62bb647 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.650298 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1755a13-dc6a-48ea-9a7c-c517e62bb647 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.656017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e1da-210d-434b-afba-46c1f624d08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.656944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e1da-210d-434b-afba-46c1f624d08d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.657228 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e1da-210d-434b-afba-46c1f624d08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.657505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e1da-210d-434b-afba-46c1f624d08d admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.661280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964e1da-210d-434b-afba-46c1f624d08d admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.663347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 49/92] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:06.663455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964e1da-210d-434b-afba-46c1f624d08d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.670827 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 44/93] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.673004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755a13-dc6a-48ea-9a7c-c517e62bb647 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.677180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e1da-210d-434b-afba-46c1f624d08d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.684087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1755a13-dc6a-48ea-9a7c-c517e62bb647 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.687812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e1da-210d-434b-afba-46c1f624d08d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.693076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dde3b-0700-4349-925f-b4c6075bb05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.693076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dde3b-0700-4349-925f-b4c6075bb05d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.693076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dde3b-0700-4349-925f-b4c6075bb05d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.693076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623dde3b-0700-4349-925f-b4c6075bb05d admin admin] PATH_INFO: `/v3/projects/1d46cc6fd680495fa9527166fa8a6e32` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.693504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dde3b-0700-4349-925f-b4c6075bb05d admin admin] RBAC: Authorizing `identity:get_project(project_id=1d46cc6fd680495fa9527166fa8a6e32)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.694753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623dde3b-0700-4349-925f-b4c6075bb05d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.697773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 50/94] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/projects/1d46cc6fd680495fa9527166fa8a6e32 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.698623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bb3f0-61bd-4f33-a218-5d0e260a32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.699503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb3f0-61bd-4f33-a218-5d0e260a32ee admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.699952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb3f0-61bd-4f33-a218-5d0e260a32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.700516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb3f0-61bd-4f33-a218-5d0e260a32ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.701826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bb3f0-61bd-4f33-a218-5d0e260a32ee admin admin] RBAC: Adding query filter params (role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09, user.id=21518ca41ca445508b5bcedf5b9db8f6) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:06.702347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bb3f0-61bd-4f33-a218-5d0e260a32ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.704078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dde3b-0700-4349-925f-b4c6075bb05d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:06.704841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bb3f0-61bd-4f33-a218-5d0e260a32ee admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.712081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 45/95] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/role_assignments?user.id=21518ca41ca445508b5bcedf5b9db8f6&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:06.716320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623dde3b-0700-4349-925f-b4c6075bb05d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:06.727826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b4e32-7b6f-4812-baf8-31b76a8534b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:06.727826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b4e32-7b6f-4812-baf8-31b76a8534b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:06.727826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b4e32-7b6f-4812-baf8-31b76a8534b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:06.727826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b4e32-7b6f-4812-baf8-31b76a8534b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:06.728194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b4e32-7b6f-4812-baf8-31b76a8534b3 admin admin] RBAC: Adding query filter params (role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=1d46cc6fd680495fa9527166fa8a6e32, user.id=21518ca41ca445508b5bcedf5b9db8f6) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:06.728194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b4e32-7b6f-4812-baf8-31b76a8534b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:06.728194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b4e32-7b6f-4812-baf8-31b76a8534b3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:06.733401 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 51/96] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:06 2022] GET /identity/v3/role_assignments?user.id=21518ca41ca445508b5bcedf5b9db8f6&scope.project.id=1d46cc6fd680495fa9527166fa8a6e32&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:09.566558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c4c0-8afa-430a-b1b5-c1bb2ddc5692 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.567506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c4c0-8afa-430a-b1b5-c1bb2ddc5692 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.567958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c4c0-8afa-430a-b1b5-c1bb2ddc5692 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.570226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 46/97] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:09.573861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9280-5f16-4b88-9279-8e3f9701ef34 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.574718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9280-5f16-4b88-9279-8e3f9701ef34 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.575259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c9280-5f16-4b88-9279-8e3f9701ef34 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.577522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 52/98] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:09.579264 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d67f6-041c-475f-ae01-a1e34673d14f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.579773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d67f6-041c-475f-ae01-a1e34673d14f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.580265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d67f6-041c-475f-ae01-a1e34673d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.583443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea58fe-74dd-4ae6-a951-4bfe4ffc9692 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.583969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea58fe-74dd-4ae6-a951-4bfe4ffc9692 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.584471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea58fe-74dd-4ae6-a951-4bfe4ffc9692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.631123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9a3d67f6-041c-475f-ae01-a1e34673d14f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:09.632455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-74ea58fe-74dd-4ae6-a951-4bfe4ffc9692 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:09.633969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9a3d67f6-041c-475f-ae01-a1e34673d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:09.635354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-74ea58fe-74dd-4ae6-a951-4bfe4ffc9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:09.650314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 47/99] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:09.652955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 53/100] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:09.688637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d67f6-041c-475f-ae01-a1e34673d14f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.691335 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea58fe-74dd-4ae6-a951-4bfe4ffc9692 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.701245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d67f6-041c-475f-ae01-a1e34673d14f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.705861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea58fe-74dd-4ae6-a951-4bfe4ffc9692 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.710072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942ec17-76f5-47ed-897c-52ddd40c80cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.710872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942ec17-76f5-47ed-897c-52ddd40c80cd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.711688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942ec17-76f5-47ed-897c-52ddd40c80cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.712109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942ec17-76f5-47ed-897c-52ddd40c80cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.717901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3da0-cabc-4578-b72a-24c4f774a5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.718984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3da0-cabc-4578-b72a-24c4f774a5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.719464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3da0-cabc-4578-b72a-24c4f774a5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.719954 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3da0-cabc-4578-b72a-24c4f774a5a8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.733118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942ec17-76f5-47ed-897c-52ddd40c80cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:09.740148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6942ec17-76f5-47ed-897c-52ddd40c80cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:28:09.741779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 48/101] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:09.745805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43befb-51b6-45f2-ab71-5072a2938495 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.746120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43befb-51b6-45f2-ab71-5072a2938495 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.746372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43befb-51b6-45f2-ab71-5072a2938495 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.747222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca3da0-cabc-4578-b72a-24c4f774a5a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:09.748225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 49/102] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:09.749539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70ce2a-f9ab-48d0-82f5-c50335727be9 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.750031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70ce2a-f9ab-48d0-82f5-c50335727be9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.750516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70ce2a-f9ab-48d0-82f5-c50335727be9 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.752511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 50/103] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:09.753386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70ce2a-f9ab-48d0-82f5-c50335727be9 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.754545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-9aca3da0-cabc-4578-b72a-24c4f774a5a8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:09.756291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 54/104] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:09.757747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56496-463e-493c-b294-2731bbddb456 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.758264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56496-463e-493c-b294-2731bbddb456 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.758738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56496-463e-493c-b294-2731bbddb456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.771968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70ce2a-f9ab-48d0-82f5-c50335727be9 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.777410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c2b84-d49d-495e-989b-b4c4be4f9cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.778210 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2b84-d49d-495e-989b-b4c4be4f9cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.778607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2b84-d49d-495e-989b-b4c4be4f9cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.778908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2b84-d49d-495e-989b-b4c4be4f9cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.779672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c2b84-d49d-495e-989b-b4c4be4f9cb0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:09.779973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c2b84-d49d-495e-989b-b4c4be4f9cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.781642 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c2b84-d49d-495e-989b-b4c4be4f9cb0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:09.783281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-17a56496-463e-493c-b294-2731bbddb456 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:09.784718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-17a56496-463e-493c-b294-2731bbddb456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:09.792084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 51/105] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:09.793382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb56a31-0c5d-4d66-a165-4cb2c2458a37 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.793669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb56a31-0c5d-4d66-a165-4cb2c2458a37 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.793945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb56a31-0c5d-4d66-a165-4cb2c2458a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.794295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 55/106] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:09.795295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a56496-463e-493c-b294-2731bbddb456 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.804698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a56496-463e-493c-b294-2731bbddb456 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.809601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45de7d-47e9-453f-b145-4950bd048ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.810493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45de7d-47e9-453f-b145-4950bd048ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.810976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45de7d-47e9-453f-b145-4950bd048ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.811562 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45de7d-47e9-453f-b145-4950bd048ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.812328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3bb56a31-0c5d-4d66-a165-4cb2c2458a37 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:09.812783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45de7d-47e9-453f-b145-4950bd048ccd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:09.813281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45de7d-47e9-453f-b145-4950bd048ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.813530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3bb56a31-0c5d-4d66-a165-4cb2c2458a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:09.815324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45de7d-47e9-453f-b145-4950bd048ccd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:09.822937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 52/107] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:09.823684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb56a31-0c5d-4d66-a165-4cb2c2458a37 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.824716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 56/108] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:09.833371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45de7d-47e9-453f-b145-4950bd048ccd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.844103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb56a31-0c5d-4d66-a165-4cb2c2458a37 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.848512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45de7d-47e9-453f-b145-4950bd048ccd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.852988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b872e2-c362-4dae-a650-1197a37081cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.853893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b872e2-c362-4dae-a650-1197a37081cb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.854173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b872e2-c362-4dae-a650-1197a37081cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.854451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b872e2-c362-4dae-a650-1197a37081cb admin admin] PATH_INFO: `/v3/users/e0df9a34c2c246f2a37da6d5472f7d68` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.854767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2679be0-8016-4570-a3f6-1e252f6e020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.855675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b872e2-c362-4dae-a650-1197a37081cb admin admin] RBAC: Authorizing `identity:get_user(user_id=e0df9a34c2c246f2a37da6d5472f7d68)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.856123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2679be0-8016-4570-a3f6-1e252f6e020a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.856637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2679be0-8016-4570-a3f6-1e252f6e020a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.857120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2679be0-8016-4570-a3f6-1e252f6e020a admin admin] PATH_INFO: `/v3/users/21518ca41ca445508b5bcedf5b9db8f6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.857528 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b872e2-c362-4dae-a650-1197a37081cb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:09.858731 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2679be0-8016-4570-a3f6-1e252f6e020a admin admin] RBAC: Authorizing `identity:get_user(user_id=21518ca41ca445508b5bcedf5b9db8f6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.859143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 53/109] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/users/e0df9a34c2c246f2a37da6d5472f7d68 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:09.859889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b872e2-c362-4dae-a650-1197a37081cb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.861540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2679be0-8016-4570-a3f6-1e252f6e020a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:09.863356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 57/110] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/users/21518ca41ca445508b5bcedf5b9db8f6 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:09.864280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2679be0-8016-4570-a3f6-1e252f6e020a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.869483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b872e2-c362-4dae-a650-1197a37081cb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.874871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4f2d-e16c-4e24-a1ff-f254aa017cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.875418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2679be0-8016-4570-a3f6-1e252f6e020a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.875654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4f2d-e16c-4e24-a1ff-f254aa017cee admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.875938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4f2d-e16c-4e24-a1ff-f254aa017cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.876212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4f2d-e16c-4e24-a1ff-f254aa017cee admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.880897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564cde-a77e-4a5e-b610-9d005614bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.881894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564cde-a77e-4a5e-b610-9d005614bb09 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.882545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564cde-a77e-4a5e-b610-9d005614bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.883905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564cde-a77e-4a5e-b610-9d005614bb09 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.887360 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b4f2d-e16c-4e24-a1ff-f254aa017cee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:09.895054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564cde-a77e-4a5e-b610-9d005614bb09 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:09.895348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ef9b4f2d-e16c-4e24-a1ff-f254aa017cee admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:09.897019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 54/111] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:09.897864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4f2d-e16c-4e24-a1ff-f254aa017cee admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.904037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6a564cde-a77e-4a5e-b610-9d005614bb09 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:09.905738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 58/112] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:09.906674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564cde-a77e-4a5e-b610-9d005614bb09 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.915250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4f2d-e16c-4e24-a1ff-f254aa017cee admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.918442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564cde-a77e-4a5e-b610-9d005614bb09 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.920401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b96e5c-9ac3-487d-8d20-83b546e9c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.921382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b96e5c-9ac3-487d-8d20-83b546e9c764 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.921735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b96e5c-9ac3-487d-8d20-83b546e9c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.922082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b96e5c-9ac3-487d-8d20-83b546e9c764 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.923341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b96e5c-9ac3-487d-8d20-83b546e9c764 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.924251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15fcd5-6cc6-4afa-a94f-61c39cb2f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.925306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15fcd5-6cc6-4afa-a94f-61c39cb2f838 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.925655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b96e5c-9ac3-487d-8d20-83b546e9c764 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:09.925983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15fcd5-6cc6-4afa-a94f-61c39cb2f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.926433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15fcd5-6cc6-4afa-a94f-61c39cb2f838 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.927684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 55/113] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:09.928305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15fcd5-6cc6-4afa-a94f-61c39cb2f838 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.928432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b96e5c-9ac3-487d-8d20-83b546e9c764 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.930743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15fcd5-6cc6-4afa-a94f-61c39cb2f838 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:09.932963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 59/114] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:09.933889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15fcd5-6cc6-4afa-a94f-61c39cb2f838 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.939629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b96e5c-9ac3-487d-8d20-83b546e9c764 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.945168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29269-4ea3-4171-beb9-2e29effdf7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.945867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29269-4ea3-4171-beb9-2e29effdf7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.946158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29269-4ea3-4171-beb9-2e29effdf7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.946358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15fcd5-6cc6-4afa-a94f-61c39cb2f838 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.946482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29269-4ea3-4171-beb9-2e29effdf7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.947234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29269-4ea3-4171-beb9-2e29effdf7f9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:09.947504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29269-4ea3-4171-beb9-2e29effdf7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.949163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29269-4ea3-4171-beb9-2e29effdf7f9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:09.952086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81611f37-9b78-4fe2-ab0a-90d5431e7fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.952983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81611f37-9b78-4fe2-ab0a-90d5431e7fff admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.953454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81611f37-9b78-4fe2-ab0a-90d5431e7fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.953903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81611f37-9b78-4fe2-ab0a-90d5431e7fff admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.954824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81611f37-9b78-4fe2-ab0a-90d5431e7fff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:09.955304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81611f37-9b78-4fe2-ab0a-90d5431e7fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.957140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81611f37-9b78-4fe2-ab0a-90d5431e7fff admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:09.958519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 56/115] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:09.960001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29269-4ea3-4171-beb9-2e29effdf7f9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.967357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 60/116] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:09.968499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81611f37-9b78-4fe2-ab0a-90d5431e7fff admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:09.971935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29269-4ea3-4171-beb9-2e29effdf7f9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.978438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf8379-1f26-46a4-867c-0705dd1c9046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.979420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf8379-1f26-46a4-867c-0705dd1c9046 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.979780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf8379-1f26-46a4-867c-0705dd1c9046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.980132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf8379-1f26-46a4-867c-0705dd1c9046 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/users/21518ca41ca445508b5bcedf5b9db8f6/roles/26c5ad3c42af492f9acc707c03567b73` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.981056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81611f37-9b78-4fe2-ab0a-90d5431e7fff admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:09.982581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf8379-1f26-46a4-867c-0705dd1c9046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c9bf6ae4fc41448605f4cdce111a09, user_id=21518ca41ca445508b5bcedf5b9db8f6, role_id=26c5ad3c42af492f9acc707c03567b73)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.985419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf8379-1f26-46a4-867c-0705dd1c9046 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:09.986390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdf104-1032-4dc4-a49a-b75e831aa3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:09.987524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdf104-1032-4dc4-a49a-b75e831aa3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:09.987977 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdf104-1032-4dc4-a49a-b75e831aa3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:09.988482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdf104-1032-4dc4-a49a-b75e831aa3a3 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/users/e0df9a34c2c246f2a37da6d5472f7d68/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:09.990964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdf104-1032-4dc4-a49a-b75e831aa3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c9bf6ae4fc41448605f4cdce111a09, user_id=e0df9a34c2c246f2a37da6d5472f7d68, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:09.992260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-27fdf104-1032-4dc4-a49a-b75e831aa3a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:09.992260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:28:09.992260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:28:09.994659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdf104-1032-4dc4-a49a-b75e831aa3a3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.003424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 57/117] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:09 2022] PUT /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/users/21518ca41ca445508b5bcedf5b9db8f6/roles/26c5ad3c42af492f9acc707c03567b73 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:10.004977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf8379-1f26-46a4-867c-0705dd1c9046 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.019882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 61/118] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:09 2022] PUT /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/users/e0df9a34c2c246f2a37da6d5472f7d68/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:10.022401 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdf104-1032-4dc4-a49a-b75e831aa3a3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.109201 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf8379-1f26-46a4-867c-0705dd1c9046 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.171521 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdf104-1032-4dc4-a49a-b75e831aa3a3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.185594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50a40e-33ff-4646-8f07-f63b27993ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.186818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a40e-33ff-4646-8f07-f63b27993ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.187289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a40e-33ff-4646-8f07-f63b27993ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.188222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50a40e-33ff-4646-8f07-f63b27993ac3 admin admin] PATH_INFO: `/v3/users/21518ca41ca445508b5bcedf5b9db8f6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.191719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50a40e-33ff-4646-8f07-f63b27993ac3 admin admin] RBAC: Authorizing `identity:get_user(user_id=21518ca41ca445508b5bcedf5b9db8f6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.194213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af50a40e-33ff-4646-8f07-f63b27993ac3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.197146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 62/119] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/users/21518ca41ca445508b5bcedf5b9db8f6 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:10.207467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50a40e-33ff-4646-8f07-f63b27993ac3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.216914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37212547-4a33-41ac-8c68-1931b8bd83e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.217544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37212547-4a33-41ac-8c68-1931b8bd83e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.217926 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37212547-4a33-41ac-8c68-1931b8bd83e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.218303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37212547-4a33-41ac-8c68-1931b8bd83e7 admin admin] PATH_INFO: `/v3/users/21518ca41ca445508b5bcedf5b9db8f6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.225320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37212547-4a33-41ac-8c68-1931b8bd83e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=21518ca41ca445508b5bcedf5b9db8f6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.227627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37212547-4a33-41ac-8c68-1931b8bd83e7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.230916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50a40e-33ff-4646-8f07-f63b27993ac3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.232636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 58/120] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/users/21518ca41ca445508b5bcedf5b9db8f6 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:10.236733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab536a5-c60e-49f1-9b02-b1b3bb3205f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.237623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab536a5-c60e-49f1-9b02-b1b3bb3205f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.237889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab536a5-c60e-49f1-9b02-b1b3bb3205f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.238161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab536a5-c60e-49f1-9b02-b1b3bb3205f6 admin admin] PATH_INFO: `/v3/projects/1d46cc6fd680495fa9527166fa8a6e32` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.239628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37212547-4a33-41ac-8c68-1931b8bd83e7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.240697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab536a5-c60e-49f1-9b02-b1b3bb3205f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=1d46cc6fd680495fa9527166fa8a6e32)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.242820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab536a5-c60e-49f1-9b02-b1b3bb3205f6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.244785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 63/121] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/projects/1d46cc6fd680495fa9527166fa8a6e32 => generated 312 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:10.255872 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab536a5-c60e-49f1-9b02-b1b3bb3205f6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.260645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37212547-4a33-41ac-8c68-1931b8bd83e7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.266373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d0b1-f6e9-4ee0-9d1d-1486f1f4788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.267252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d0b1-f6e9-4ee0-9d1d-1486f1f4788b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.267530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d0b1-f6e9-4ee0-9d1d-1486f1f4788b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.267808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d0b1-f6e9-4ee0-9d1d-1486f1f4788b admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.270411 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843d0b1-f6e9-4ee0-9d1d-1486f1f4788b admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.272517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843d0b1-f6e9-4ee0-9d1d-1486f1f4788b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.274960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 59/122] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:10.277310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab536a5-c60e-49f1-9b02-b1b3bb3205f6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.281050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d0b1-f6e9-4ee0-9d1d-1486f1f4788b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.288178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b85e7b-7b2d-4642-a0c4-fc561e81166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.289205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b85e7b-7b2d-4642-a0c4-fc561e81166d admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.289486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b85e7b-7b2d-4642-a0c4-fc561e81166d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.289770 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b85e7b-7b2d-4642-a0c4-fc561e81166d admin admin] PATH_INFO: `/v3/projects/1d46cc6fd680495fa9527166fa8a6e32/users/21518ca41ca445508b5bcedf5b9db8f6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.293323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b85e7b-7b2d-4642-a0c4-fc561e81166d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d46cc6fd680495fa9527166fa8a6e32, user_id=21518ca41ca445508b5bcedf5b9db8f6, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.296150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b85e7b-7b2d-4642-a0c4-fc561e81166d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.303261 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d0b1-f6e9-4ee0-9d1d-1486f1f4788b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.309327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11465d-2665-46d9-a7ef-63d537f2eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.310331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11465d-2665-46d9-a7ef-63d537f2eb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.311521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11465d-2665-46d9-a7ef-63d537f2eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.313101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11465d-2665-46d9-a7ef-63d537f2eb8d admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/users/21518ca41ca445508b5bcedf5b9db8f6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.319365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 64/123] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:10 2022] PUT /identity/v3/projects/1d46cc6fd680495fa9527166fa8a6e32/users/21518ca41ca445508b5bcedf5b9db8f6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:10.324752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11465d-2665-46d9-a7ef-63d537f2eb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c9bf6ae4fc41448605f4cdce111a09, user_id=21518ca41ca445508b5bcedf5b9db8f6, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.328046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11465d-2665-46d9-a7ef-63d537f2eb8d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.335021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108647f-9e5f-49f5-9271-471e0a25ffea None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.335422 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108647f-9e5f-49f5-9271-471e0a25ffea None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.335574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108647f-9e5f-49f5-9271-471e0a25ffea None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.338387 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 65/124] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:10.345181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642f9ec-ed3c-4a68-b378-7406614dcbcb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.345563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642f9ec-ed3c-4a68-b378-7406614dcbcb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.345993 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642f9ec-ed3c-4a68-b378-7406614dcbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.360545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 60/125] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:10 2022] PUT /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/users/21518ca41ca445508b5bcedf5b9db8f6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:10.373099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9642f9ec-ed3c-4a68-b378-7406614dcbcb None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:10.374456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9642f9ec-ed3c-4a68-b378-7406614dcbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:10.446976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 66/126] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 07 02:28:10.472597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11465d-2665-46d9-a7ef-63d537f2eb8d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.485306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11465d-2665-46d9-a7ef-63d537f2eb8d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.491627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4474e-cafd-4e90-94f1-26ae778ff2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.493195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4474e-cafd-4e90-94f1-26ae778ff2bc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.493579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4474e-cafd-4e90-94f1-26ae778ff2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.493954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4474e-cafd-4e90-94f1-26ae778ff2bc admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.517644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4474e-cafd-4e90-94f1-26ae778ff2bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:10.525058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-20d4474e-cafd-4e90-94f1-26ae778ff2bc admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 02:28:10.526477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 61/127] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:10.532606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642f9ec-ed3c-4a68-b378-7406614dcbcb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.547346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642f9ec-ed3c-4a68-b378-7406614dcbcb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.555572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bece1-b5ab-424c-928f-8f7478174676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.556388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bece1-b5ab-424c-928f-8f7478174676 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.556685 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bece1-b5ab-424c-928f-8f7478174676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.556967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bece1-b5ab-424c-928f-8f7478174676 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.557837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bece1-b5ab-424c-928f-8f7478174676 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:10.558156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bece1-b5ab-424c-928f-8f7478174676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.559934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bece1-b5ab-424c-928f-8f7478174676 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.576489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 67/128] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:10.582283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4474e-cafd-4e90-94f1-26ae778ff2bc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.594397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4474e-cafd-4e90-94f1-26ae778ff2bc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.599045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac9176-16b8-499e-84e2-94ed7ae50357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.600034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac9176-16b8-499e-84e2-94ed7ae50357 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.600443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac9176-16b8-499e-84e2-94ed7ae50357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.600818 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac9176-16b8-499e-84e2-94ed7ae50357 admin admin] PATH_INFO: `/v3/users/43d24f8c7e2f4c4eaeeea3fbd61dbdfc` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.616317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac9176-16b8-499e-84e2-94ed7ae50357 admin admin] RBAC: Authorizing `identity:get_user(user_id=43d24f8c7e2f4c4eaeeea3fbd61dbdfc)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.619128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac9176-16b8-499e-84e2-94ed7ae50357 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.621050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 62/129] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/users/43d24f8c7e2f4c4eaeeea3fbd61dbdfc => generated 289 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:10.626829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bece1-b5ab-424c-928f-8f7478174676 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.641480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bece1-b5ab-424c-928f-8f7478174676 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.646886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520f3b8-1ede-4985-b958-2c3e7a160ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.647548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520f3b8-1ede-4985-b958-2c3e7a160ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.647835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520f3b8-1ede-4985-b958-2c3e7a160ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.648117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520f3b8-1ede-4985-b958-2c3e7a160ba0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.659242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520f3b8-1ede-4985-b958-2c3e7a160ba0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.661132 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520f3b8-1ede-4985-b958-2c3e7a160ba0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.670870 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 68/130] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:10.676267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac9176-16b8-499e-84e2-94ed7ae50357 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.688092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac9176-16b8-499e-84e2-94ed7ae50357 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.692695 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d163b9-da8e-4a5b-aeaf-f8d76675d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.693562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d163b9-da8e-4a5b-aeaf-f8d76675d181 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.693847 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d163b9-da8e-4a5b-aeaf-f8d76675d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.694129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d163b9-da8e-4a5b-aeaf-f8d76675d181 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.695926 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d163b9-da8e-4a5b-aeaf-f8d76675d181 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.698457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d163b9-da8e-4a5b-aeaf-f8d76675d181 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.699909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 63/131] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:10.705873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520f3b8-1ede-4985-b958-2c3e7a160ba0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.719186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520f3b8-1ede-4985-b958-2c3e7a160ba0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.719436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08477a-6a10-4bde-852c-209a7f43fa1b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.719436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08477a-6a10-4bde-852c-209a7f43fa1b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.719436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08477a-6a10-4bde-852c-209a7f43fa1b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.719436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 64/132] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:10.721310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe955-328a-4c06-9b79-da8185817f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.721966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe955-328a-4c06-9b79-da8185817f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.722250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe955-328a-4c06-9b79-da8185817f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.722532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe955-328a-4c06-9b79-da8185817f4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.723383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fe955-328a-4c06-9b79-da8185817f4e admin admin] RBAC: Adding query filter params (role.id=e2ec2f293cf340b3b7aca8230c9b877a, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09, user.id=43d24f8c7e2f4c4eaeeea3fbd61dbdfc) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:10.723696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fe955-328a-4c06-9b79-da8185817f4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.726972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bb112-1256-43cf-ab34-80d7a6206b73 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.726972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bb112-1256-43cf-ab34-80d7a6206b73 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.726972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bb112-1256-43cf-ab34-80d7a6206b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.728795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fe955-328a-4c06-9b79-da8185817f4e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.734487 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 69/133] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/role_assignments?user.id=43d24f8c7e2f4c4eaeeea3fbd61dbdfc&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=e2ec2f293cf340b3b7aca8230c9b877a => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:10.748995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-309bb112-1256-43cf-ab34-80d7a6206b73 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:10.750521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-309bb112-1256-43cf-ab34-80d7a6206b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:10.759674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 65/134] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:10.784136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe955-328a-4c06-9b79-da8185817f4e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.797907 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe955-328a-4c06-9b79-da8185817f4e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.809438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1ee9-a67d-4bcd-b609-168e1585b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.810262 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1ee9-a67d-4bcd-b609-168e1585b4de admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.810547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1ee9-a67d-4bcd-b609-168e1585b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.810828 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1ee9-a67d-4bcd-b609-168e1585b4de admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.812070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e1ee9-a67d-4bcd-b609-168e1585b4de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.813856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e1ee9-a67d-4bcd-b609-168e1585b4de admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.815538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 70/135] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:10.822621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bb112-1256-43cf-ab34-80d7a6206b73 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:10.837983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bb112-1256-43cf-ab34-80d7a6206b73 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:10.846234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355ceb9-040d-43bb-9352-7dc3429efebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:10.847334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355ceb9-040d-43bb-9352-7dc3429efebe admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:10.847804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355ceb9-040d-43bb-9352-7dc3429efebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:10.848262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355ceb9-040d-43bb-9352-7dc3429efebe admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:10.849257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355ceb9-040d-43bb-9352-7dc3429efebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:10.852128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355ceb9-040d-43bb-9352-7dc3429efebe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:10.901782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 66/136] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:28:10 2022] POST /identity/v3/projects => generated 302 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:13.458287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11ccb1-6edc-44ae-a3d2-5bfdb523d67a None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.458828 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11ccb1-6edc-44ae-a3d2-5bfdb523d67a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.458828 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11ccb1-6edc-44ae-a3d2-5bfdb523d67a None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.460754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 71/137] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:13.467308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53801d1-ec16-4c4f-9395-b2f9f9f0a9dc None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.467795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53801d1-ec16-4c4f-9395-b2f9f9f0a9dc None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.467868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53801d1-ec16-4c4f-9395-b2f9f9f0a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.493418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b53801d1-ec16-4c4f-9395-b2f9f9f0a9dc None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:13.494638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b53801d1-ec16-4c4f-9395-b2f9f9f0a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:13.565847 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 67/138] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:13.603677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11ccb1-6edc-44ae-a3d2-5bfdb523d67a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.616100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11ccb1-6edc-44ae-a3d2-5bfdb523d67a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.620632 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc4f6e-0c66-4b24-a88f-3e498dd80bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.621423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4f6e-0c66-4b24-a88f-3e498dd80bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.621708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4f6e-0c66-4b24-a88f-3e498dd80bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.621995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc4f6e-0c66-4b24-a88f-3e498dd80bfa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.643096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc4f6e-0c66-4b24-a88f-3e498dd80bfa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:13.650586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-19dc4f6e-0c66-4b24-a88f-3e498dd80bfa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:13.651978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 72/139] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:13.657890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53801d1-ec16-4c4f-9395-b2f9f9f0a9dc None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.669652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53801d1-ec16-4c4f-9395-b2f9f9f0a9dc None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.676992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ff1de-7f5e-4176-b52f-64172c4f29e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.677624 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff1de-7f5e-4176-b52f-64172c4f29e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.677918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff1de-7f5e-4176-b52f-64172c4f29e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.678196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ff1de-7f5e-4176-b52f-64172c4f29e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.678975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff1de-7f5e-4176-b52f-64172c4f29e9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:13.679284 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff1de-7f5e-4176-b52f-64172c4f29e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:13.681146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ff1de-7f5e-4176-b52f-64172c4f29e9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:13.691617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7f8b2-3951-436d-a9c8-9228e731c4d0 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.691904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7f8b2-3951-436d-a9c8-9228e731c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.692186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7f8b2-3951-436d-a9c8-9228e731c4d0 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.694147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 73/140] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:13.694320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 68/141] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:13.696667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7f8b2-3951-436d-a9c8-9228e731c4d0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.711558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e82eb-4bee-4d4e-aaf8-0d636fe1e553 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.711820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e82eb-4bee-4d4e-aaf8-0d636fe1e553 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.712042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e82eb-4bee-4d4e-aaf8-0d636fe1e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.722451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7f8b2-3951-436d-a9c8-9228e731c4d0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.735755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487d8e6-62a5-4ee8-9c32-fa752a481226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.736677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487d8e6-62a5-4ee8-9c32-fa752a481226 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.736963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487d8e6-62a5-4ee8-9c32-fa752a481226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.737242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487d8e6-62a5-4ee8-9c32-fa752a481226 admin admin] PATH_INFO: `/v3/users/21518ca41ca445508b5bcedf5b9db8f6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.738571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487d8e6-62a5-4ee8-9c32-fa752a481226 admin admin] RBAC: Authorizing `identity:get_user(user_id=21518ca41ca445508b5bcedf5b9db8f6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:13.740842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487d8e6-62a5-4ee8-9c32-fa752a481226 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:13.742672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 74/142] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/users/21518ca41ca445508b5bcedf5b9db8f6 => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:13.748421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487d8e6-62a5-4ee8-9c32-fa752a481226 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.749389 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-644e82eb-4bee-4d4e-aaf8-0d636fe1e553 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:13.750617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-644e82eb-4bee-4d4e-aaf8-0d636fe1e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:13.759007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487d8e6-62a5-4ee8-9c32-fa752a481226 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.774685 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d708e3-64d4-4ff4-bea3-dc2524ecf0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.775499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 69/143] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:13.775693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d708e3-64d4-4ff4-bea3-dc2524ecf0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.775693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d708e3-64d4-4ff4-bea3-dc2524ecf0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.775975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d708e3-64d4-4ff4-bea3-dc2524ecf0d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.784761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d708e3-64d4-4ff4-bea3-dc2524ecf0d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:13.786537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d708e3-64d4-4ff4-bea3-dc2524ecf0d0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:13.804495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 75/144] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:13.810237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d708e3-64d4-4ff4-bea3-dc2524ecf0d0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.810436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e82eb-4bee-4d4e-aaf8-0d636fe1e553 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.819849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d708e3-64d4-4ff4-bea3-dc2524ecf0d0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.827049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e82eb-4bee-4d4e-aaf8-0d636fe1e553 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.829526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6af93-ff3d-4169-9b11-a1d2fd985863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.830329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6af93-ff3d-4169-9b11-a1d2fd985863 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.830616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6af93-ff3d-4169-9b11-a1d2fd985863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.830900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6af93-ff3d-4169-9b11-a1d2fd985863 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.845011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a149e18-938b-4bf0-8a55-8b10ac0bd4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.845897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149e18-938b-4bf0-8a55-8b10ac0bd4ff admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.846181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149e18-938b-4bf0-8a55-8b10ac0bd4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.846459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149e18-938b-4bf0-8a55-8b10ac0bd4ff admin admin] PATH_INFO: `/v3/projects/1d46cc6fd680495fa9527166fa8a6e32` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.847046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6af93-ff3d-4169-9b11-a1d2fd985863 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:13.847710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a149e18-938b-4bf0-8a55-8b10ac0bd4ff admin admin] RBAC: Authorizing `identity:get_project(project_id=1d46cc6fd680495fa9527166fa8a6e32)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:13.849796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a149e18-938b-4bf0-8a55-8b10ac0bd4ff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:13.851671 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 70/145] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/projects/1d46cc6fd680495fa9527166fa8a6e32 => generated 312 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:13.852774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c320cf8-5c4d-4ade-81d2-d4db1195a559 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.853020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c320cf8-5c4d-4ade-81d2-d4db1195a559 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.853296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c320cf8-5c4d-4ade-81d2-d4db1195a559 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.854950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 71/146] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:13.856480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-63a6af93-ff3d-4169-9b11-a1d2fd985863 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 02:28:13.857713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 76/147] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:13.861801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6af93-ff3d-4169-9b11-a1d2fd985863 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.862226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c350d-5efd-46b0-a197-fe081be2b40c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.862503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c350d-5efd-46b0-a197-fe081be2b40c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.862780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c350d-5efd-46b0-a197-fe081be2b40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.875268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6af93-ff3d-4169-9b11-a1d2fd985863 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.888621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411d6fc-bc4d-474c-8003-61ae04eabe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.889277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411d6fc-bc4d-474c-8003-61ae04eabe1f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.889556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411d6fc-bc4d-474c-8003-61ae04eabe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.889826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411d6fc-bc4d-474c-8003-61ae04eabe1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.890672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411d6fc-bc4d-474c-8003-61ae04eabe1f admin admin] RBAC: Adding query filter params (role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=1d46cc6fd680495fa9527166fa8a6e32, user.id=21518ca41ca445508b5bcedf5b9db8f6) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:13.890992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411d6fc-bc4d-474c-8003-61ae04eabe1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:13.892896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411d6fc-bc4d-474c-8003-61ae04eabe1f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:13.895519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fb8c350d-5efd-46b0-a197-fe081be2b40c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:13.896805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fb8c350d-5efd-46b0-a197-fe081be2b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:13.905772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 77/148] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/role_assignments?user.id=21518ca41ca445508b5bcedf5b9db8f6&scope.project.id=1d46cc6fd680495fa9527166fa8a6e32&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:13.906588 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411d6fc-bc4d-474c-8003-61ae04eabe1f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.915435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 72/149] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:13.920702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411d6fc-bc4d-474c-8003-61ae04eabe1f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.925261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56191dc-bada-4aad-bd95-e5c1a9ffacf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.925931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56191dc-bada-4aad-bd95-e5c1a9ffacf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.926280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56191dc-bada-4aad-bd95-e5c1a9ffacf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.926550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56191dc-bada-4aad-bd95-e5c1a9ffacf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.927332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56191dc-bada-4aad-bd95-e5c1a9ffacf7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:13.927637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56191dc-bada-4aad-bd95-e5c1a9ffacf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:13.929330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56191dc-bada-4aad-bd95-e5c1a9ffacf7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:13.939284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 78/150] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:13.944951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c350d-5efd-46b0-a197-fe081be2b40c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.955712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c350d-5efd-46b0-a197-fe081be2b40c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.958992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56191dc-bada-4aad-bd95-e5c1a9ffacf7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.966220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813384a-1d55-479f-8ecf-ede0478bbab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.967162 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813384a-1d55-479f-8ecf-ede0478bbab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.967521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813384a-1d55-479f-8ecf-ede0478bbab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.967877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813384a-1d55-479f-8ecf-ede0478bbab5 admin admin] PATH_INFO: `/v3/users/43d24f8c7e2f4c4eaeeea3fbd61dbdfc` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:13.969386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813384a-1d55-479f-8ecf-ede0478bbab5 admin admin] RBAC: Authorizing `identity:get_user(user_id=43d24f8c7e2f4c4eaeeea3fbd61dbdfc)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:13.971009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56191dc-bada-4aad-bd95-e5c1a9ffacf7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:13.971771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813384a-1d55-479f-8ecf-ede0478bbab5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:13.974056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 73/151] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/users/43d24f8c7e2f4c4eaeeea3fbd61dbdfc => generated 289 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:13.986150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813384a-1d55-479f-8ecf-ede0478bbab5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:13.986847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7ee44-01ba-4848-b15d-172a887cde5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:13.987883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7ee44-01ba-4848-b15d-172a887cde5a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:13.988331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7ee44-01ba-4848-b15d-172a887cde5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:13.988798 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7ee44-01ba-4848-b15d-172a887cde5a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.001653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7ee44-01ba-4848-b15d-172a887cde5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:14.004636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813384a-1d55-479f-8ecf-ede0478bbab5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.009359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-12b7ee44-01ba-4848-b15d-172a887cde5a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:14.010825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 79/152] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:14.020550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7ee44-01ba-4848-b15d-172a887cde5a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.025221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630520a5-2c4d-4c52-abe0-b58e8a45ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.026589 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630520a5-2c4d-4c52-abe0-b58e8a45ebbc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.026883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630520a5-2c4d-4c52-abe0-b58e8a45ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.027170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630520a5-2c4d-4c52-abe0-b58e8a45ebbc admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.031006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630520a5-2c4d-4c52-abe0-b58e8a45ebbc admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.033192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630520a5-2c4d-4c52-abe0-b58e8a45ebbc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.038870 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7ee44-01ba-4848-b15d-172a887cde5a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.040548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 74/153] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:13 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:14.042220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcebb5-24d4-4d4c-9590-b246b179b7d5 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.042510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcebb5-24d4-4d4c-9590-b246b179b7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.042793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcebb5-24d4-4d4c-9590-b246b179b7d5 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.044668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 75/154] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:14.045421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcebb5-24d4-4d4c-9590-b246b179b7d5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.057336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f54437-e830-46c0-95df-a8ebc720cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.058038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f54437-e830-46c0-95df-a8ebc720cfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.058324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f54437-e830-46c0-95df-a8ebc720cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.058602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f54437-e830-46c0-95df-a8ebc720cfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.059385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f54437-e830-46c0-95df-a8ebc720cfc1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:14.059696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f54437-e830-46c0-95df-a8ebc720cfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.061385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f54437-e830-46c0-95df-a8ebc720cfc1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.079436 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 80/155] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.080854 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d7d85-6cac-48dd-8fa4-1d9deb56f3ae None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.081143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d7d85-6cac-48dd-8fa4-1d9deb56f3ae None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.081420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d7d85-6cac-48dd-8fa4-1d9deb56f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.083981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcebb5-24d4-4d4c-9590-b246b179b7d5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.091626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e648-5738-472b-a83e-56245ff94ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.092575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e648-5738-472b-a83e-56245ff94ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.092863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e648-5738-472b-a83e-56245ff94ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.093145 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653e648-5738-472b-a83e-56245ff94ac5 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/users/43d24f8c7e2f4c4eaeeea3fbd61dbdfc/roles/e2ec2f293cf340b3b7aca8230c9b877a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.098768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653e648-5738-472b-a83e-56245ff94ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c9bf6ae4fc41448605f4cdce111a09, user_id=43d24f8c7e2f4c4eaeeea3fbd61dbdfc, role_id=e2ec2f293cf340b3b7aca8230c9b877a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.102051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653e648-5738-472b-a83e-56245ff94ac5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.117007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-149d7d85-6cac-48dd-8fa4-1d9deb56f3ae None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:14.119037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-149d7d85-6cac-48dd-8fa4-1d9deb56f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:14.131215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 76/156] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:14 2022] PUT /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/users/43d24f8c7e2f4c4eaeeea3fbd61dbdfc/roles/e2ec2f293cf340b3b7aca8230c9b877a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:14.132150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e648-5738-472b-a83e-56245ff94ac5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.133012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 81/157] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:14.146933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdcbe8-4f76-410e-afe2-347eba2de9bb None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.147530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdcbe8-4f76-410e-afe2-347eba2de9bb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.147807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdcbe8-4f76-410e-afe2-347eba2de9bb None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.149686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 82/158] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:14.156499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f31ab-6326-427e-829a-1af30e1c35bd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.156499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f31ab-6326-427e-829a-1af30e1c35bd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.156499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f31ab-6326-427e-829a-1af30e1c35bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.189802 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c30f31ab-6326-427e-829a-1af30e1c35bd None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:14.190995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c30f31ab-6326-427e-829a-1af30e1c35bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:14.224553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653e648-5738-472b-a83e-56245ff94ac5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.230305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ac2f7-57db-4a08-981f-6cd00ca2e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.231194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ac2f7-57db-4a08-981f-6cd00ca2e231 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.231476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ac2f7-57db-4a08-981f-6cd00ca2e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.231752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ac2f7-57db-4a08-981f-6cd00ca2e231 admin admin] PATH_INFO: `/v3/users/21518ca41ca445508b5bcedf5b9db8f6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.233053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ac2f7-57db-4a08-981f-6cd00ca2e231 admin admin] RBAC: Authorizing `identity:get_user(user_id=21518ca41ca445508b5bcedf5b9db8f6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.235254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ac2f7-57db-4a08-981f-6cd00ca2e231 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.237935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 77/159] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/users/21518ca41ca445508b5bcedf5b9db8f6 => generated 275 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.238788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ac2f7-57db-4a08-981f-6cd00ca2e231 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.248749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ac2f7-57db-4a08-981f-6cd00ca2e231 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.258782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45067902-d7de-477f-84a8-90ae0c614185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.259592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45067902-d7de-477f-84a8-90ae0c614185 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.259873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45067902-d7de-477f-84a8-90ae0c614185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.260143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45067902-d7de-477f-84a8-90ae0c614185 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.272914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45067902-d7de-477f-84a8-90ae0c614185 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:14.280498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-45067902-d7de-477f-84a8-90ae0c614185 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:28:14.281349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 83/160] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:14.282044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 78/161] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:14.282760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f31ab-6326-427e-829a-1af30e1c35bd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.287934 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45067902-d7de-477f-84a8-90ae0c614185 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.295690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f31ab-6326-427e-829a-1af30e1c35bd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.301074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65edcf-26d0-4367-a9f5-2ab0521db895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.302142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65edcf-26d0-4367-a9f5-2ab0521db895 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.302679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65edcf-26d0-4367-a9f5-2ab0521db895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.303152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65edcf-26d0-4367-a9f5-2ab0521db895 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.304154 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45067902-d7de-477f-84a8-90ae0c614185 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.308728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedddf6-d039-4574-bfb5-b075fd5c5df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.309393 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedddf6-d039-4574-bfb5-b075fd5c5df3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.309670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedddf6-d039-4574-bfb5-b075fd5c5df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.309943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedddf6-d039-4574-bfb5-b075fd5c5df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.310711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedddf6-d039-4574-bfb5-b075fd5c5df3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:14.311011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedddf6-d039-4574-bfb5-b075fd5c5df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.313185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedddf6-d039-4574-bfb5-b075fd5c5df3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.317406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65edcf-26d0-4367-a9f5-2ab0521db895 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.319361 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65edcf-26d0-4367-a9f5-2ab0521db895 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.322666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 79/162] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:14.323854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60bfcf-98f1-4888-b5b9-dde4ca1580c3 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.324467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60bfcf-98f1-4888-b5b9-dde4ca1580c3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.324570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60bfcf-98f1-4888-b5b9-dde4ca1580c3 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.326639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 80/163] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:14.327439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60bfcf-98f1-4888-b5b9-dde4ca1580c3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.330475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 84/164] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:14.335604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65edcf-26d0-4367-a9f5-2ab0521db895 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.340481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60bfcf-98f1-4888-b5b9-dde4ca1580c3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.346165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65edcf-26d0-4367-a9f5-2ab0521db895 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.347739 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331666e-4783-4f06-b7a1-c8ea700f6e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.348771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331666e-4783-4f06-b7a1-c8ea700f6e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.349251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331666e-4783-4f06-b7a1-c8ea700f6e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.349689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331666e-4783-4f06-b7a1-c8ea700f6e93 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.352508 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3e608-bf0a-44da-ba73-f5a01f2ab749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.353380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3e608-bf0a-44da-ba73-f5a01f2ab749 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.353661 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3e608-bf0a-44da-ba73-f5a01f2ab749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.353937 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3e608-bf0a-44da-ba73-f5a01f2ab749 admin admin] PATH_INFO: `/v3/users/e0df9a34c2c246f2a37da6d5472f7d68` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.355811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3e608-bf0a-44da-ba73-f5a01f2ab749 admin admin] RBAC: Authorizing `identity:get_user(user_id=e0df9a34c2c246f2a37da6d5472f7d68)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.357696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3e608-bf0a-44da-ba73-f5a01f2ab749 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.359666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 85/165] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/users/e0df9a34c2c246f2a37da6d5472f7d68 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.360924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d424c9-ee7d-480e-9081-d7c344fe55f6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.361187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d424c9-ee7d-480e-9081-d7c344fe55f6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.361518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d424c9-ee7d-480e-9081-d7c344fe55f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.365565 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331666e-4783-4f06-b7a1-c8ea700f6e93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:14.372826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0331666e-4783-4f06-b7a1-c8ea700f6e93 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:14.374178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 81/166] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:14.374804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331666e-4783-4f06-b7a1-c8ea700f6e93 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.381071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-91d424c9-ee7d-480e-9081-d7c344fe55f6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:14.382269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-91d424c9-ee7d-480e-9081-d7c344fe55f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:14.385409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331666e-4783-4f06-b7a1-c8ea700f6e93 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.389938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02940c-1741-431f-8ce1-bdb3e1f2d212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.390169 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 86/167] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:14.390774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02940c-1741-431f-8ce1-bdb3e1f2d212 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.390963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d424c9-ee7d-480e-9081-d7c344fe55f6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.391064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02940c-1741-431f-8ce1-bdb3e1f2d212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.391310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02940c-1741-431f-8ce1-bdb3e1f2d212 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.392533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02940c-1741-431f-8ce1-bdb3e1f2d212 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.394578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02940c-1741-431f-8ce1-bdb3e1f2d212 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.396248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 82/168] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.397008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02940c-1741-431f-8ce1-bdb3e1f2d212 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.404471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d424c9-ee7d-480e-9081-d7c344fe55f6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.407383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02940c-1741-431f-8ce1-bdb3e1f2d212 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.408988 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf1de9-2842-48a2-89fe-3a066d3a0fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.409586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1de9-2842-48a2-89fe-3a066d3a0fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.409868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1de9-2842-48a2-89fe-3a066d3a0fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.410142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf1de9-2842-48a2-89fe-3a066d3a0fd5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.411841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3ec2-bd67-4d81-bbd6-fff500a4d895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.412645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3ec2-bd67-4d81-bbd6-fff500a4d895 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.413054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3ec2-bd67-4d81-bbd6-fff500a4d895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.413450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3ec2-bd67-4d81-bbd6-fff500a4d895 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.414889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f3ec2-bd67-4d81-bbd6-fff500a4d895 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:14.415315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f3ec2-bd67-4d81-bbd6-fff500a4d895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.417050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f3ec2-bd67-4d81-bbd6-fff500a4d895 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.419546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf1de9-2842-48a2-89fe-3a066d3a0fd5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.421382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf1de9-2842-48a2-89fe-3a066d3a0fd5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.425562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 83/169] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.426664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3ec2-bd67-4d81-bbd6-fff500a4d895 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.430619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 87/170] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:14.431286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf1de9-2842-48a2-89fe-3a066d3a0fd5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.435462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3ec2-bd67-4d81-bbd6-fff500a4d895 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.440001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e2518-6689-4ec8-96df-37cc52e7f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.440158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf1de9-2842-48a2-89fe-3a066d3a0fd5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.440905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e2518-6689-4ec8-96df-37cc52e7f3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.441012 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e2518-6689-4ec8-96df-37cc52e7f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.441195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e2518-6689-4ec8-96df-37cc52e7f3a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.442018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e2518-6689-4ec8-96df-37cc52e7f3a8 admin admin] RBAC: Adding query filter params (role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09, user.id=21518ca41ca445508b5bcedf5b9db8f6) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:14.442325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e2518-6689-4ec8-96df-37cc52e7f3a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.444169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e2518-6689-4ec8-96df-37cc52e7f3a8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.445206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49886ab2-4654-4b65-ab15-19bf89eb76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.445974 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49886ab2-4654-4b65-ab15-19bf89eb76a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.446253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49886ab2-4654-4b65-ab15-19bf89eb76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.446520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49886ab2-4654-4b65-ab15-19bf89eb76a5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.447708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49886ab2-4654-4b65-ab15-19bf89eb76a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.449415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49886ab2-4654-4b65-ab15-19bf89eb76a5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.450182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 84/171] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/role_assignments?user.id=21518ca41ca445508b5bcedf5b9db8f6&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.451377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e2518-6689-4ec8-96df-37cc52e7f3a8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.451475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 88/172] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.451972 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49886ab2-4654-4b65-ab15-19bf89eb76a5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.462820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49886ab2-4654-4b65-ab15-19bf89eb76a5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.466133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e2518-6689-4ec8-96df-37cc52e7f3a8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.467555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537255a-3079-4d95-af49-f26e0b25c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.468496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537255a-3079-4d95-af49-f26e0b25c649 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.468767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537255a-3079-4d95-af49-f26e0b25c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.469035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537255a-3079-4d95-af49-f26e0b25c649 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.470238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537255a-3079-4d95-af49-f26e0b25c649 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.470724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc279a-9d60-4736-a421-e0dfc0003dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.471588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc279a-9d60-4736-a421-e0dfc0003dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.471864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc279a-9d60-4736-a421-e0dfc0003dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.472133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc279a-9d60-4736-a421-e0dfc0003dbc admin admin] PATH_INFO: `/v3/users/21518ca41ca445508b5bcedf5b9db8f6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.472406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537255a-3079-4d95-af49-f26e0b25c649 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.473368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc279a-9d60-4736-a421-e0dfc0003dbc admin admin] RBAC: Authorizing `identity:get_user(user_id=21518ca41ca445508b5bcedf5b9db8f6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.474147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 89/173] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.479608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537255a-3079-4d95-af49-f26e0b25c649 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.479859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc279a-9d60-4736-a421-e0dfc0003dbc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.479859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 85/174] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/users/21518ca41ca445508b5bcedf5b9db8f6 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.483516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc279a-9d60-4736-a421-e0dfc0003dbc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.492976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537255a-3079-4d95-af49-f26e0b25c649 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.493666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc279a-9d60-4736-a421-e0dfc0003dbc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.498653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c859e-aa40-410b-8b82-e759b4ea2a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.499320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bacd52-744c-4403-895e-8ea65c399d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.499441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c859e-aa40-410b-8b82-e759b4ea2a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.499658 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c859e-aa40-410b-8b82-e759b4ea2a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.499937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c859e-aa40-410b-8b82-e759b4ea2a2d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.500733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bacd52-744c-4403-895e-8ea65c399d55 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.500926 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c859e-aa40-410b-8b82-e759b4ea2a2d admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09, user.id=e0df9a34c2c246f2a37da6d5472f7d68) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:14.501191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c859e-aa40-410b-8b82-e759b4ea2a2d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.501600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bacd52-744c-4403-895e-8ea65c399d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.502066 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bacd52-744c-4403-895e-8ea65c399d55 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.503005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bacd52-744c-4403-895e-8ea65c399d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.503187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c859e-aa40-410b-8b82-e759b4ea2a2d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.505637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bacd52-744c-4403-895e-8ea65c399d55 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.515576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 86/175] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/role_assignments?user.id=e0df9a34c2c246f2a37da6d5472f7d68&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.515576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c859e-aa40-410b-8b82-e759b4ea2a2d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.530316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c859e-aa40-410b-8b82-e759b4ea2a2d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.535741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c68c-03ad-4c05-a9ec-40b3859994ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.536555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c68c-03ad-4c05-a9ec-40b3859994ec admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.536991 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c68c-03ad-4c05-a9ec-40b3859994ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.541031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434c68c-03ad-4c05-a9ec-40b3859994ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.545779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 90/176] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:14 2022] POST /identity/v3/users => generated 283 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:14.553234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434c68c-03ad-4c05-a9ec-40b3859994ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.555149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434c68c-03ad-4c05-a9ec-40b3859994ec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.565983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 87/177] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:14.573794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bacd52-744c-4403-895e-8ea65c399d55 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.585430 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bacd52-744c-4403-895e-8ea65c399d55 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.591682 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81add69a-e8ca-4939-b86b-b4a0c4e21106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.592819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add69a-e8ca-4939-b86b-b4a0c4e21106 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.593240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add69a-e8ca-4939-b86b-b4a0c4e21106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.593611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add69a-e8ca-4939-b86b-b4a0c4e21106 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.595399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81add69a-e8ca-4939-b86b-b4a0c4e21106 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.598044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81add69a-e8ca-4939-b86b-b4a0c4e21106 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.604771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 91/178] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:14.607352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c68c-03ad-4c05-a9ec-40b3859994ec admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:14.617843 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434c68c-03ad-4c05-a9ec-40b3859994ec admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:14.623763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55caed-f4f9-403b-a025-cfdf8e7bfdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:14.631068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55caed-f4f9-403b-a025-cfdf8e7bfdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:14.631713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55caed-f4f9-403b-a025-cfdf8e7bfdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:14.632259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55caed-f4f9-403b-a025-cfdf8e7bfdc7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:14.633953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55caed-f4f9-403b-a025-cfdf8e7bfdc7 admin admin] RBAC: Adding query filter params (role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09, user.id=21518ca41ca445508b5bcedf5b9db8f6) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:14.634333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55caed-f4f9-403b-a025-cfdf8e7bfdc7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:14.636574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55caed-f4f9-403b-a025-cfdf8e7bfdc7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:14.645107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 88/179] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:14 2022] GET /identity/v3/role_assignments?user.id=21518ca41ca445508b5bcedf5b9db8f6&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:16.496831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16ba08-f488-4bf6-b10b-7750ed9c9851 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:16.497374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16ba08-f488-4bf6-b10b-7750ed9c9851 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:16.497374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16ba08-f488-4bf6-b10b-7750ed9c9851 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:16.499163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 92/180] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:16.504550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc01254-4a9c-4f05-b905-88da8afcb00e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:16.505019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc01254-4a9c-4f05-b905-88da8afcb00e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:16.505183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc01254-4a9c-4f05-b905-88da8afcb00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:16.523010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-abc01254-4a9c-4f05-b905-88da8afcb00e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:16.524783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-abc01254-4a9c-4f05-b905-88da8afcb00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:16.532697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 89/181] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:16.557185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16ba08-f488-4bf6-b10b-7750ed9c9851 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:16.569476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16ba08-f488-4bf6-b10b-7750ed9c9851 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:16.574424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8edb43-1e2e-442b-918a-d3fa7ab1eace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:16.575201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8edb43-1e2e-442b-918a-d3fa7ab1eace admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:16.575476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8edb43-1e2e-442b-918a-d3fa7ab1eace admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:16.575746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8edb43-1e2e-442b-918a-d3fa7ab1eace admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:16.586590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8edb43-1e2e-442b-918a-d3fa7ab1eace admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:16.593445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-ce8edb43-1e2e-442b-918a-d3fa7ab1eace admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 02:28:16.594649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 93/182] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:16.600429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc01254-4a9c-4f05-b905-88da8afcb00e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:16.609597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc01254-4a9c-4f05-b905-88da8afcb00e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:16.614211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140543f7-777e-494b-a9a7-160ca3854a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:16.614873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140543f7-777e-494b-a9a7-160ca3854a8c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:16.615155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140543f7-777e-494b-a9a7-160ca3854a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:16.615432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140543f7-777e-494b-a9a7-160ca3854a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:16.616197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140543f7-777e-494b-a9a7-160ca3854a8c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:16.616535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140543f7-777e-494b-a9a7-160ca3854a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:16.618742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140543f7-777e-494b-a9a7-160ca3854a8c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:16.630295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 90/183] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:16.638363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8edb43-1e2e-442b-918a-d3fa7ab1eace admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:16.649346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8edb43-1e2e-442b-918a-d3fa7ab1eace admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:16.653743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f00d8-4119-415d-adb0-a162b5e0dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:16.654596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f00d8-4119-415d-adb0-a162b5e0dd24 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:16.654874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f00d8-4119-415d-adb0-a162b5e0dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:16.655146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f00d8-4119-415d-adb0-a162b5e0dd24 admin admin] PATH_INFO: `/v3/users/43d24f8c7e2f4c4eaeeea3fbd61dbdfc` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:16.656364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f00d8-4119-415d-adb0-a162b5e0dd24 admin admin] RBAC: Authorizing `identity:get_user(user_id=43d24f8c7e2f4c4eaeeea3fbd61dbdfc)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:16.658525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f00d8-4119-415d-adb0-a162b5e0dd24 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:16.660295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 94/184] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:16 2022] GET /identity/v3/users/43d24f8c7e2f4c4eaeeea3fbd61dbdfc => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:16.665570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140543f7-777e-494b-a9a7-160ca3854a8c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:16.680514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140543f7-777e-494b-a9a7-160ca3854a8c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:16.684968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec98aa-5c39-441e-80ea-751baa8a97bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:16.685617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec98aa-5c39-441e-80ea-751baa8a97bc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:16.685897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec98aa-5c39-441e-80ea-751baa8a97bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:16.686168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec98aa-5c39-441e-80ea-751baa8a97bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:16.694384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec98aa-5c39-441e-80ea-751baa8a97bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:16.696735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec98aa-5c39-441e-80ea-751baa8a97bc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:16.706028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 91/185] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:16.711653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f00d8-4119-415d-adb0-a162b5e0dd24 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:16.721852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f00d8-4119-415d-adb0-a162b5e0dd24 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:16.726290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0987e1c-9e87-4fb8-8eb1-e31a2311f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:16.727216 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0987e1c-9e87-4fb8-8eb1-e31a2311f3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:16.727493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0987e1c-9e87-4fb8-8eb1-e31a2311f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:16.727765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0987e1c-9e87-4fb8-8eb1-e31a2311f3c0 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:16.728990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0987e1c-9e87-4fb8-8eb1-e31a2311f3c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:16.731022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0987e1c-9e87-4fb8-8eb1-e31a2311f3c0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:16.732730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 95/186] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:16 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:16.738503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec98aa-5c39-441e-80ea-751baa8a97bc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:16.749083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec98aa-5c39-441e-80ea-751baa8a97bc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:16.753420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417e00b-47e0-4e8f-98c8-5ce48bf060f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:16.754066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417e00b-47e0-4e8f-98c8-5ce48bf060f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:16.754343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417e00b-47e0-4e8f-98c8-5ce48bf060f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:16.754618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417e00b-47e0-4e8f-98c8-5ce48bf060f1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:16.755459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417e00b-47e0-4e8f-98c8-5ce48bf060f1 admin admin] RBAC: Adding query filter params (role.id=e2ec2f293cf340b3b7aca8230c9b877a, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09, user.id=43d24f8c7e2f4c4eaeeea3fbd61dbdfc) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:16.755769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417e00b-47e0-4e8f-98c8-5ce48bf060f1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:16.758195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417e00b-47e0-4e8f-98c8-5ce48bf060f1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:16.764262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 92/187] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:16 2022] GET /identity/v3/role_assignments?user.id=43d24f8c7e2f4c4eaeeea3fbd61dbdfc&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=e2ec2f293cf340b3b7aca8230c9b877a => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:17.085305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387765d1-4f56-4d5b-9633-85cd19c55a8a None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.085528 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387765d1-4f56-4d5b-9633-85cd19c55a8a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.085817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387765d1-4f56-4d5b-9633-85cd19c55a8a None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.087714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 96/188] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:17.092771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8b08-7022-4d4f-ad57-28554c46dbbf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.093059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8b08-7022-4d4f-ad57-28554c46dbbf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.093334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8b08-7022-4d4f-ad57-28554c46dbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.111403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d6aa8b08-7022-4d4f-ad57-28554c46dbbf None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:17.112597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d6aa8b08-7022-4d4f-ad57-28554c46dbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:17.120809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 93/189] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:17.143647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387765d1-4f56-4d5b-9633-85cd19c55a8a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.155457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387765d1-4f56-4d5b-9633-85cd19c55a8a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.159915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf9133-de3c-4abc-bae4-1ce0c676b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.160657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71cc4-02e2-4269-8bb0-bad8ff9bd206 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.160783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf9133-de3c-4abc-bae4-1ce0c676b5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.160943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71cc4-02e2-4269-8bb0-bad8ff9bd206 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.161035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf9133-de3c-4abc-bae4-1ce0c676b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.161219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c71cc4-02e2-4269-8bb0-bad8ff9bd206 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.161329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf9133-de3c-4abc-bae4-1ce0c676b5c9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.163330 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 94/190] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:17.168790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d852b03-f7c5-427d-9862-76abb8197ef3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.169076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d852b03-f7c5-427d-9862-76abb8197ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.169355 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d852b03-f7c5-427d-9862-76abb8197ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.172113 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf9133-de3c-4abc-bae4-1ce0c676b5c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:17.178827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-3acf9133-de3c-4abc-bae4-1ce0c676b5c9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:28:17.180614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 97/191] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:17.182898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0ea69-e861-4104-ae91-b40458aef186 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.183192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0ea69-e861-4104-ae91-b40458aef186 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.183467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0ea69-e861-4104-ae91-b40458aef186 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.185286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 98/192] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:17.186024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0ea69-e861-4104-ae91-b40458aef186 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.187425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5d852b03-f7c5-427d-9862-76abb8197ef3 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:17.188627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5d852b03-f7c5-427d-9862-76abb8197ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:17.196159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 95/193] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:17.198099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0ea69-e861-4104-ae91-b40458aef186 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.201932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b99832-621e-49b0-940f-faf628be593e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.202269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b99832-621e-49b0-940f-faf628be593e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.202544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b99832-621e-49b0-940f-faf628be593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.202698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dacbd-41fe-4670-bbc8-84bc3eee97bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.203268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dacbd-41fe-4670-bbc8-84bc3eee97bf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.203549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dacbd-41fe-4670-bbc8-84bc3eee97bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.203823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dacbd-41fe-4670-bbc8-84bc3eee97bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.204611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dacbd-41fe-4670-bbc8-84bc3eee97bf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:17.204916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dacbd-41fe-4670-bbc8-84bc3eee97bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.206501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dacbd-41fe-4670-bbc8-84bc3eee97bf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.222133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 99/194] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:17.222133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dacbd-41fe-4670-bbc8-84bc3eee97bf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.223083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e4b99832-621e-49b0-940f-faf628be593e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:17.224253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e4b99832-621e-49b0-940f-faf628be593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:17.231482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dacbd-41fe-4670-bbc8-84bc3eee97bf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.232195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 96/195] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:17.232984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b99832-621e-49b0-940f-faf628be593e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.239807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a57830-e4d8-4882-8dae-6f07552539b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.240543 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a57830-e4d8-4882-8dae-6f07552539b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.240823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a57830-e4d8-4882-8dae-6f07552539b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.241093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a57830-e4d8-4882-8dae-6f07552539b0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.241717 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b99832-621e-49b0-940f-faf628be593e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.246071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5abe7c-9bce-4dca-8994-92a1a6ce144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.246907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5abe7c-9bce-4dca-8994-92a1a6ce144e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.247183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5abe7c-9bce-4dca-8994-92a1a6ce144e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.247454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5abe7c-9bce-4dca-8994-92a1a6ce144e admin admin] PATH_INFO: `/v3/users/08b1ed4e2ded4493880aa67fa5866b42` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.252118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a57830-e4d8-4882-8dae-6f07552539b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:17.260286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f1a57830-e4d8-4882-8dae-6f07552539b0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:17.261702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 100/196] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:17.262631 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5abe7c-9bce-4dca-8994-92a1a6ce144e admin admin] RBAC: Authorizing `identity:get_user(user_id=08b1ed4e2ded4493880aa67fa5866b42)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.264180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a57830-e4d8-4882-8dae-6f07552539b0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.264849 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5abe7c-9bce-4dca-8994-92a1a6ce144e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.266673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 97/197] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/users/08b1ed4e2ded4493880aa67fa5866b42 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:17.267317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5abe7c-9bce-4dca-8994-92a1a6ce144e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.274601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a57830-e4d8-4882-8dae-6f07552539b0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.277233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5abe7c-9bce-4dca-8994-92a1a6ce144e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.278852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9644a7-fd21-42c0-9514-96d3248e5e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.279605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9644a7-fd21-42c0-9514-96d3248e5e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.279882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9644a7-fd21-42c0-9514-96d3248e5e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.280153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9644a7-fd21-42c0-9514-96d3248e5e8d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.281338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9644a7-fd21-42c0-9514-96d3248e5e8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.281507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225cbe-6961-4b4e-bbb9-f02d443cab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.282140 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225cbe-6961-4b4e-bbb9-f02d443cab47 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.282417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225cbe-6961-4b4e-bbb9-f02d443cab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.282693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e225cbe-6961-4b4e-bbb9-f02d443cab47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.283010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9644a7-fd21-42c0-9514-96d3248e5e8d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.283442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e225cbe-6961-4b4e-bbb9-f02d443cab47 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:17.283747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e225cbe-6961-4b4e-bbb9-f02d443cab47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.284619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 101/198] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:17.285320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e225cbe-6961-4b4e-bbb9-f02d443cab47 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.289755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9644a7-fd21-42c0-9514-96d3248e5e8d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.298191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 98/199] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:17.298191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225cbe-6961-4b4e-bbb9-f02d443cab47 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.298939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9644a7-fd21-42c0-9514-96d3248e5e8d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.303613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ce1c7-af73-433d-916a-9c497b1fa691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.304120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e225cbe-6961-4b4e-bbb9-f02d443cab47 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.304233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ce1c7-af73-433d-916a-9c497b1fa691 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.304548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ce1c7-af73-433d-916a-9c497b1fa691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.304824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ce1c7-af73-433d-916a-9c497b1fa691 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.308335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ba0f9-e2ff-495f-a07e-6346bb9d8cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.308978 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ba0f9-e2ff-495f-a07e-6346bb9d8cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.309259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ba0f9-e2ff-495f-a07e-6346bb9d8cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.309531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ba0f9-e2ff-495f-a07e-6346bb9d8cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.310239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ba0f9-e2ff-495f-a07e-6346bb9d8cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.312107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ba0f9-e2ff-495f-a07e-6346bb9d8cc2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.313183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ce1c7-af73-433d-916a-9c497b1fa691 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.314894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ce1c7-af73-433d-916a-9c497b1fa691 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.324942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 102/200] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:17.326170 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ce1c7-af73-433d-916a-9c497b1fa691 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.332133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 99/201] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:17 2022] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:17.333217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ba0f9-e2ff-495f-a07e-6346bb9d8cc2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.335362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ce1c7-af73-433d-916a-9c497b1fa691 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.340285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1ffa-0ccb-400b-ab89-52dfc465f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.341201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1ffa-0ccb-400b-ab89-52dfc465f490 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.341480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1ffa-0ccb-400b-ab89-52dfc465f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.341761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d1ffa-0ccb-400b-ab89-52dfc465f490 admin admin] PATH_INFO: `/v3/users/08b1ed4e2ded4493880aa67fa5866b42` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.343044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1ffa-0ccb-400b-ab89-52dfc465f490 admin admin] RBAC: Authorizing `identity:get_user(user_id=08b1ed4e2ded4493880aa67fa5866b42)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.344070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ba0f9-e2ff-495f-a07e-6346bb9d8cc2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.345261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d1ffa-0ccb-400b-ab89-52dfc465f490 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.346965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 103/202] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/users/08b1ed4e2ded4493880aa67fa5866b42 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:17.348757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915afd1-37ad-4175-ad2d-07f1b47691a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.349639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915afd1-37ad-4175-ad2d-07f1b47691a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.349921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915afd1-37ad-4175-ad2d-07f1b47691a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.350199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915afd1-37ad-4175-ad2d-07f1b47691a7 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.352207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915afd1-37ad-4175-ad2d-07f1b47691a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.353197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1ffa-0ccb-400b-ab89-52dfc465f490 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.354279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915afd1-37ad-4175-ad2d-07f1b47691a7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.356093 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 100/203] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:17.362262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915afd1-37ad-4175-ad2d-07f1b47691a7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.369213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d1ffa-0ccb-400b-ab89-52dfc465f490 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.372274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915afd1-37ad-4175-ad2d-07f1b47691a7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.373990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed123a-64de-4117-9a10-47ffb3c7b71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.374649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed123a-64de-4117-9a10-47ffb3c7b71c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.374927 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed123a-64de-4117-9a10-47ffb3c7b71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.375205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed123a-64de-4117-9a10-47ffb3c7b71c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.376787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01de218-9c29-41e0-bda0-3d1c7cd2b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.377443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de218-9c29-41e0-bda0-3d1c7cd2b103 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.377726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de218-9c29-41e0-bda0-3d1c7cd2b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.378003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de218-9c29-41e0-bda0-3d1c7cd2b103 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.378851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01de218-9c29-41e0-bda0-3d1c7cd2b103 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf, user.id=08b1ed4e2ded4493880aa67fa5866b42) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:17.379160 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01de218-9c29-41e0-bda0-3d1c7cd2b103 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.381081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01de218-9c29-41e0-bda0-3d1c7cd2b103 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.384027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed123a-64de-4117-9a10-47ffb3c7b71c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.385883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed123a-64de-4117-9a10-47ffb3c7b71c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.387774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 101/204] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/role_assignments?user.id=08b1ed4e2ded4493880aa67fa5866b42&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:17.396493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 104/205] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 02:28:17.402953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01de218-9c29-41e0-bda0-3d1c7cd2b103 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.413759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01de218-9c29-41e0-bda0-3d1c7cd2b103 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.419122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160fb7a-6d64-492b-b917-697431ae07d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.420045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160fb7a-6d64-492b-b917-697431ae07d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.420328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160fb7a-6d64-492b-b917-697431ae07d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.420631 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160fb7a-6d64-492b-b917-697431ae07d0 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.421986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160fb7a-6d64-492b-b917-697431ae07d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.424126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160fb7a-6d64-492b-b917-697431ae07d0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.426272 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 102/206] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:17.432601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed123a-64de-4117-9a10-47ffb3c7b71c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:17.442381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed123a-64de-4117-9a10-47ffb3c7b71c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:17.447343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f526176-fd10-4bb8-8e80-fcf312ddb821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:17.448209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f526176-fd10-4bb8-8e80-fcf312ddb821 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:17.448525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f526176-fd10-4bb8-8e80-fcf312ddb821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:17.448798 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f526176-fd10-4bb8-8e80-fcf312ddb821 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:17.449665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f526176-fd10-4bb8-8e80-fcf312ddb821 admin admin] RBAC: Adding query filter params (role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf, user.id=08b1ed4e2ded4493880aa67fa5866b42) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:17.449976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f526176-fd10-4bb8-8e80-fcf312ddb821 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:17.452178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f526176-fd10-4bb8-8e80-fcf312ddb821 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:17.458765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 105/207] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:17 2022] GET /identity/v3/role_assignments?user.id=08b1ed4e2ded4493880aa67fa5866b42&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:19.632613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608cb40-6826-451d-8a47-15c14613d6c8 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.633606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608cb40-6826-451d-8a47-15c14613d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.633679 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608cb40-6826-451d-8a47-15c14613d6c8 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.635748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 103/208] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:19.641994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420361-141d-49f4-916e-4bd109ae0c21 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.642446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420361-141d-49f4-916e-4bd109ae0c21 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.642622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420361-141d-49f4-916e-4bd109ae0c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.661889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9a420361-141d-49f4-916e-4bd109ae0c21 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:19.663084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9a420361-141d-49f4-916e-4bd109ae0c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:19.671442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 106/209] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:19.694421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608cb40-6826-451d-8a47-15c14613d6c8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.710412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608cb40-6826-451d-8a47-15c14613d6c8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.711782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136287-2ba9-47f0-9c72-cc9e329a60e3 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.712054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136287-2ba9-47f0-9c72-cc9e329a60e3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.712332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136287-2ba9-47f0-9c72-cc9e329a60e3 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.714410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 107/210] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:19.716605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ed243-3d44-4ff7-9896-f451b1099f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.717712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ed243-3d44-4ff7-9896-f451b1099f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.718247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ed243-3d44-4ff7-9896-f451b1099f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.718779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ed243-3d44-4ff7-9896-f451b1099f3b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.719265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bb6ff-dd41-405e-b9ba-ed210542981f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.719545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bb6ff-dd41-405e-b9ba-ed210542981f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.719832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bb6ff-dd41-405e-b9ba-ed210542981f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.734577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ed243-3d44-4ff7-9896-f451b1099f3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:19.738527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c03bb6ff-dd41-405e-b9ba-ed210542981f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:19.739833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c03bb6ff-dd41-405e-b9ba-ed210542981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:19.741769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b88ed243-3d44-4ff7-9896-f451b1099f3b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:28:19.743142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 104/211] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:19.744378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6582-6475-492f-b062-21c0a39cf046 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.744636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6582-6475-492f-b062-21c0a39cf046 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.744913 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b6582-6475-492f-b062-21c0a39cf046 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.746583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 105/212] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:19.748771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6582-6475-492f-b062-21c0a39cf046 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.754713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 108/213] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:19.756141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403958b-7a02-4075-8a54-7e3f97743282 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.756461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403958b-7a02-4075-8a54-7e3f97743282 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.756737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403958b-7a02-4075-8a54-7e3f97743282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.766887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b6582-6475-492f-b062-21c0a39cf046 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.771211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7910f2-71a7-4450-abca-6311463f1eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.771857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7910f2-71a7-4450-abca-6311463f1eee admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.772139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7910f2-71a7-4450-abca-6311463f1eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.772444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7910f2-71a7-4450-abca-6311463f1eee admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.773732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7910f2-71a7-4450-abca-6311463f1eee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:19.774036 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7910f2-71a7-4450-abca-6311463f1eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:19.774875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9403958b-7a02-4075-8a54-7e3f97743282 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:19.775620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7910f2-71a7-4450-abca-6311463f1eee admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:19.776035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9403958b-7a02-4075-8a54-7e3f97743282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:19.783728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 109/214] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:19.784251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 106/215] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:19.785269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7910f2-71a7-4450-abca-6311463f1eee admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.786087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3aa74-de4c-456d-8a02-37f9793981d0 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.786383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3aa74-de4c-456d-8a02-37f9793981d0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.786663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3aa74-de4c-456d-8a02-37f9793981d0 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.788414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 110/216] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:19.791196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3aa74-de4c-456d-8a02-37f9793981d0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.797197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7910f2-71a7-4450-abca-6311463f1eee admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.801790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd6cf3-0b6f-4467-a897-ff9378d26ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.802558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd6cf3-0b6f-4467-a897-ff9378d26ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.802841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd6cf3-0b6f-4467-a897-ff9378d26ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.803115 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd6cf3-0b6f-4467-a897-ff9378d26ab7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.803860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3aa74-de4c-456d-8a02-37f9793981d0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.808110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e93b5b-2f49-4420-a266-288fef43897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.808973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e93b5b-2f49-4420-a266-288fef43897a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.809248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e93b5b-2f49-4420-a266-288fef43897a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.809516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e93b5b-2f49-4420-a266-288fef43897a admin admin] PATH_INFO: `/v3/users/08b1ed4e2ded4493880aa67fa5866b42` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.810697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e93b5b-2f49-4420-a266-288fef43897a admin admin] RBAC: Authorizing `identity:get_user(user_id=08b1ed4e2ded4493880aa67fa5866b42)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:19.812848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e93b5b-2f49-4420-a266-288fef43897a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:19.813703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd6cf3-0b6f-4467-a897-ff9378d26ab7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:19.814430 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 111/217] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/users/08b1ed4e2ded4493880aa67fa5866b42 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:19.816573 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd737-2c89-416c-9672-3a06ac496680 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.816860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd737-2c89-416c-9672-3a06ac496680 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.817139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd737-2c89-416c-9672-3a06ac496680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.821158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-cdcd6cf3-0b6f-4467-a897-ff9378d26ab7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:19.822319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 107/218] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:19.823072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd6cf3-0b6f-4467-a897-ff9378d26ab7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.833167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd6cf3-0b6f-4467-a897-ff9378d26ab7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.835446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8d1fd737-2c89-416c-9672-3a06ac496680 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:19.837290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8d1fd737-2c89-416c-9672-3a06ac496680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:19.838090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062ec8f-9043-4a4a-b75d-691f16b220bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.838841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062ec8f-9043-4a4a-b75d-691f16b220bb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.839122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062ec8f-9043-4a4a-b75d-691f16b220bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.839470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062ec8f-9043-4a4a-b75d-691f16b220bb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.844873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 112/219] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:19.845682 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd737-2c89-416c-9672-3a06ac496680 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.849986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062ec8f-9043-4a4a-b75d-691f16b220bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:19.854338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd737-2c89-416c-9672-3a06ac496680 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.857227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0062ec8f-9043-4a4a-b75d-691f16b220bb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:19.862878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 108/220] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:19.863006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318da90-3fc5-4750-83e1-2fde42d746e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.863110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062ec8f-9043-4a4a-b75d-691f16b220bb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.863206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318da90-3fc5-4750-83e1-2fde42d746e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.863206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318da90-3fc5-4750-83e1-2fde42d746e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.863206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318da90-3fc5-4750-83e1-2fde42d746e7 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.864173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318da90-3fc5-4750-83e1-2fde42d746e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:19.866257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318da90-3fc5-4750-83e1-2fde42d746e7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:19.868045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 113/221] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:19.872506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318da90-3fc5-4750-83e1-2fde42d746e7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.872715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062ec8f-9043-4a4a-b75d-691f16b220bb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.876975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54289e5f-1871-41d2-b9c7-f9a47df2384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.877604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54289e5f-1871-41d2-b9c7-f9a47df2384c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.877884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54289e5f-1871-41d2-b9c7-f9a47df2384c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.878158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54289e5f-1871-41d2-b9c7-f9a47df2384c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.878353 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318da90-3fc5-4750-83e1-2fde42d746e7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.878916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54289e5f-1871-41d2-b9c7-f9a47df2384c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:19.879217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54289e5f-1871-41d2-b9c7-f9a47df2384c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:19.880832 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54289e5f-1871-41d2-b9c7-f9a47df2384c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:19.883258 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902e7e5-0131-4587-aa14-10daa3002c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.883816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e7e5-0131-4587-aa14-10daa3002c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.884097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e7e5-0131-4587-aa14-10daa3002c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.884399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e7e5-0131-4587-aa14-10daa3002c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.885163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902e7e5-0131-4587-aa14-10daa3002c25 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:19.885464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902e7e5-0131-4587-aa14-10daa3002c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:19.886982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902e7e5-0131-4587-aa14-10daa3002c25 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:19.890019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 109/222] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:19.891813 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54289e5f-1871-41d2-b9c7-f9a47df2384c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.895231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 114/223] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:19.896017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902e7e5-0131-4587-aa14-10daa3002c25 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.902543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54289e5f-1871-41d2-b9c7-f9a47df2384c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.905616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902e7e5-0131-4587-aa14-10daa3002c25 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.906852 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607164a7-7bc9-4f3c-9c3e-c3a6f2b5e08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.907607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607164a7-7bc9-4f3c-9c3e-c3a6f2b5e08f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.907891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607164a7-7bc9-4f3c-9c3e-c3a6f2b5e08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.908165 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607164a7-7bc9-4f3c-9c3e-c3a6f2b5e08f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.909390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607164a7-7bc9-4f3c-9c3e-c3a6f2b5e08f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:19.910080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0e1a4-96b3-4afa-920d-5eb2ab396227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.910906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0e1a4-96b3-4afa-920d-5eb2ab396227 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.911038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607164a7-7bc9-4f3c-9c3e-c3a6f2b5e08f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:19.911182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0e1a4-96b3-4afa-920d-5eb2ab396227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.911450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0e1a4-96b3-4afa-920d-5eb2ab396227 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/users/08b1ed4e2ded4493880aa67fa5866b42/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.912820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 110/224] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:19.913477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0e1a4-96b3-4afa-920d-5eb2ab396227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1177859f1c41a78c7659b4df5f0dbf, user_id=08b1ed4e2ded4493880aa67fa5866b42, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:19.916210 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0e1a4-96b3-4afa-920d-5eb2ab396227 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:19.917019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607164a7-7bc9-4f3c-9c3e-c3a6f2b5e08f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.926394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607164a7-7bc9-4f3c-9c3e-c3a6f2b5e08f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.928692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 115/225] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:19 2022] PUT /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/users/08b1ed4e2ded4493880aa67fa5866b42/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:19.929551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0e1a4-96b3-4afa-920d-5eb2ab396227 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:19.991263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c7f65-d724-48fd-9b1b-ca37d1d4a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:19.992390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c7f65-d724-48fd-9b1b-ca37d1d4a2be admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:19.992683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c7f65-d724-48fd-9b1b-ca37d1d4a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:19.992959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c7f65-d724-48fd-9b1b-ca37d1d4a2be admin admin] PATH_INFO: `/v3/users/e105c16d19e44bdfbe1944c3bcd4a54c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:19.994214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0e1a4-96b3-4afa-920d-5eb2ab396227 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:19.999185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf7614-37da-438e-831d-a4e243b6b318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:20.000166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf7614-37da-438e-831d-a4e243b6b318 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:20.000398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf7614-37da-438e-831d-a4e243b6b318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:20.000745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf7614-37da-438e-831d-a4e243b6b318 admin admin] PATH_INFO: `/v3/users/08b1ed4e2ded4493880aa67fa5866b42` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:20.002336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf7614-37da-438e-831d-a4e243b6b318 admin admin] RBAC: Authorizing `identity:get_user(user_id=08b1ed4e2ded4493880aa67fa5866b42)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:20.004556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf7614-37da-438e-831d-a4e243b6b318 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:20.006307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 116/226] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/users/08b1ed4e2ded4493880aa67fa5866b42 => generated 283 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:20.007142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf7614-37da-438e-831d-a4e243b6b318 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:20.009487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c7f65-d724-48fd-9b1b-ca37d1d4a2be admin admin] RBAC: Authorizing `identity:get_user(user_id=e105c16d19e44bdfbe1944c3bcd4a54c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:20.011698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c7f65-d724-48fd-9b1b-ca37d1d4a2be admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:20.018269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 111/227] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:19 2022] GET /identity/v3/users/e105c16d19e44bdfbe1944c3bcd4a54c => generated 297 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:20.018269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c7f65-d724-48fd-9b1b-ca37d1d4a2be admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:20.023126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf7614-37da-438e-831d-a4e243b6b318 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:20.024891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c7f65-d724-48fd-9b1b-ca37d1d4a2be admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:20.029492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70525b4-3a75-4c8f-aac1-7db3604d7378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:20.029843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c593b-90d8-4b8f-ace2-0d8259a8bfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:20.030524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70525b4-3a75-4c8f-aac1-7db3604d7378 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:20.030664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c593b-90d8-4b8f-ace2-0d8259a8bfcc admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:20.030837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70525b4-3a75-4c8f-aac1-7db3604d7378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:20.030930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c593b-90d8-4b8f-ace2-0d8259a8bfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:20.031068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70525b4-3a75-4c8f-aac1-7db3604d7378 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:20.031153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c593b-90d8-4b8f-ace2-0d8259a8bfcc admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:20.032535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c593b-90d8-4b8f-ace2-0d8259a8bfcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:20.032646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70525b4-3a75-4c8f-aac1-7db3604d7378 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:20.035148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c593b-90d8-4b8f-ace2-0d8259a8bfcc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:20.035348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70525b4-3a75-4c8f-aac1-7db3604d7378 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:20.037822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 112/228] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:20 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:20.038590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70525b4-3a75-4c8f-aac1-7db3604d7378 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:20.050000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70525b4-3a75-4c8f-aac1-7db3604d7378 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:20.055082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3f7a9-5f8c-4116-a361-5e74ddbd94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:20.055749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3f7a9-5f8c-4116-a361-5e74ddbd94c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:20.056028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3f7a9-5f8c-4116-a361-5e74ddbd94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:20.056314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3f7a9-5f8c-4116-a361-5e74ddbd94c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:20.058888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 117/229] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:20 2022] POST /identity/v3/users => generated 297 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:20.058888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c593b-90d8-4b8f-ace2-0d8259a8bfcc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:20.067942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3f7a9-5f8c-4116-a361-5e74ddbd94c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:20.067942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3f7a9-5f8c-4116-a361-5e74ddbd94c2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:20.078136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 113/230] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:20.080235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c593b-90d8-4b8f-ace2-0d8259a8bfcc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:20.084011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3f7a9-5f8c-4116-a361-5e74ddbd94c2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:20.085546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf9879-4d06-4d0d-9b31-7e8c04d67457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:20.087052 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9879-4d06-4d0d-9b31-7e8c04d67457 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:20.087328 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9879-4d06-4d0d-9b31-7e8c04d67457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:20.087599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9879-4d06-4d0d-9b31-7e8c04d67457 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/users/08b1ed4e2ded4493880aa67fa5866b42/roles/26c5ad3c42af492f9acc707c03567b73` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:20.091088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf9879-4d06-4d0d-9b31-7e8c04d67457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1177859f1c41a78c7659b4df5f0dbf, user_id=08b1ed4e2ded4493880aa67fa5866b42, role_id=26c5ad3c42af492f9acc707c03567b73)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:20.094294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf9879-4d06-4d0d-9b31-7e8c04d67457 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:20.094601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3f7a9-5f8c-4116-a361-5e74ddbd94c2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:20.099780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83000678-6e66-462b-9f02-2a00260c78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:20.100728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83000678-6e66-462b-9f02-2a00260c78ef admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:20.101014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83000678-6e66-462b-9f02-2a00260c78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:20.101451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83000678-6e66-462b-9f02-2a00260c78ef admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:20.103054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83000678-6e66-462b-9f02-2a00260c78ef admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:20.106593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83000678-6e66-462b-9f02-2a00260c78ef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:20.109959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 114/231] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:20 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:20.113360 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 118/232] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:20 2022] PUT /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/users/08b1ed4e2ded4493880aa67fa5866b42/roles/26c5ad3c42af492f9acc707c03567b73 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:20.115914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83000678-6e66-462b-9f02-2a00260c78ef admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:20.127554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83000678-6e66-462b-9f02-2a00260c78ef admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:20.196319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d05a01-94e3-4b40-bea2-1342c4fd3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:20.197427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d05a01-94e3-4b40-bea2-1342c4fd3268 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:20.197950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d05a01-94e3-4b40-bea2-1342c4fd3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:20.198424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d05a01-94e3-4b40-bea2-1342c4fd3268 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:20.199586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d05a01-94e3-4b40-bea2-1342c4fd3268 admin admin] RBAC: Adding query filter params (role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf, user.id=e105c16d19e44bdfbe1944c3bcd4a54c) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:20.200174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d05a01-94e3-4b40-bea2-1342c4fd3268 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:20.202697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d05a01-94e3-4b40-bea2-1342c4fd3268 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:20.209457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 115/233] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:20 2022] GET /identity/v3/role_assignments?user.id=e105c16d19e44bdfbe1944c3bcd4a54c&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 259 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:22.799464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7a2b1-a967-4df5-8e79-930bb215f800 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.799966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7a2b1-a967-4df5-8e79-930bb215f800 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.800038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7a2b1-a967-4df5-8e79-930bb215f800 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.801830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 119/234] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:22.806378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee59197-058c-452b-bd74-e7f89093a752 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.806801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee59197-058c-452b-bd74-e7f89093a752 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.806974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee59197-058c-452b-bd74-e7f89093a752 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.808743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 116/235] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:22.814144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705f967-5c55-48fc-bbec-fba3b9c96351 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.814428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705f967-5c55-48fc-bbec-fba3b9c96351 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.814706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705f967-5c55-48fc-bbec-fba3b9c96351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.825724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac62e1-4249-4405-8d49-4c80dd0553e4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.826270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac62e1-4249-4405-8d49-4c80dd0553e4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.826545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac62e1-4249-4405-8d49-4c80dd0553e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.843493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7705f967-5c55-48fc-bbec-fba3b9c96351 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:22.844718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7705f967-5c55-48fc-bbec-fba3b9c96351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:22.856592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-caac62e1-4249-4405-8d49-4c80dd0553e4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:22.857788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-caac62e1-4249-4405-8d49-4c80dd0553e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:22.860659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 120/236] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:22.862181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405bf90-0535-4b6f-8574-e44f508f7d75 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.862473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405bf90-0535-4b6f-8574-e44f508f7d75 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.862755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405bf90-0535-4b6f-8574-e44f508f7d75 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.864973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 121/237] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:22.870418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 117/238] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:22.871522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd60900-8ed7-4c0f-99d9-45775cdcf811 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.871811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd60900-8ed7-4c0f-99d9-45775cdcf811 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.872089 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd60900-8ed7-4c0f-99d9-45775cdcf811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.890618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac62e1-4249-4405-8d49-4c80dd0553e4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:22.891357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6cd60900-8ed7-4c0f-99d9-45775cdcf811 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:22.892591 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6cd60900-8ed7-4c0f-99d9-45775cdcf811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:22.900868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 122/239] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:22.901150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac62e1-4249-4405-8d49-4c80dd0553e4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:22.905556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b69d5-6b14-4a93-b01e-f32b7257ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:22.906346 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b69d5-6b14-4a93-b01e-f32b7257ac26 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.906623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b69d5-6b14-4a93-b01e-f32b7257ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.906895 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b69d5-6b14-4a93-b01e-f32b7257ac26 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.918368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b69d5-6b14-4a93-b01e-f32b7257ac26 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:22.920152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd60900-8ed7-4c0f-99d9-45775cdcf811 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:22.925527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-826b69d5-6b14-4a93-b01e-f32b7257ac26 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:28:22.926802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 118/240] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:22.927959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753c7d1-c007-4f19-84b3-1939ff6c3769 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.928305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753c7d1-c007-4f19-84b3-1939ff6c3769 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.928605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753c7d1-c007-4f19-84b3-1939ff6c3769 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.930485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd60900-8ed7-4c0f-99d9-45775cdcf811 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:22.930859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 119/241] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:22.931546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753c7d1-c007-4f19-84b3-1939ff6c3769 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:22.935468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07a0c0-f2d8-4601-b02c-c72cd1715353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:22.936263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a0c0-f2d8-4601-b02c-c72cd1715353 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.936595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a0c0-f2d8-4601-b02c-c72cd1715353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.936873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a0c0-f2d8-4601-b02c-c72cd1715353 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.944493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753c7d1-c007-4f19-84b3-1939ff6c3769 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:22.947747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07a0c0-f2d8-4601-b02c-c72cd1715353 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:22.948789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78136de2-667d-4444-9787-813237f4cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:22.949544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78136de2-667d-4444-9787-813237f4cb20 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.949824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78136de2-667d-4444-9787-813237f4cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.950094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78136de2-667d-4444-9787-813237f4cb20 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.954932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6c07a0c0-f2d8-4601-b02c-c72cd1715353 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 02:28:22.956252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 123/242] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:22.960458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7a840-5716-451d-978a-ffb9f1fbb141 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.960458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7a840-5716-451d-978a-ffb9f1fbb141 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.960458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7a840-5716-451d-978a-ffb9f1fbb141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.961395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78136de2-667d-4444-9787-813237f4cb20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:22.968502 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-78136de2-667d-4444-9787-813237f4cb20 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:22.969678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 120/243] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:22.970429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78136de2-667d-4444-9787-813237f4cb20 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:22.977683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4bd7a840-5716-451d-978a-ffb9f1fbb141 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:22.978865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4bd7a840-5716-451d-978a-ffb9f1fbb141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:22.980465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78136de2-667d-4444-9787-813237f4cb20 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:22.985283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f236ba3-0226-4c51-953c-9259b6dfc86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:22.985927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f236ba3-0226-4c51-953c-9259b6dfc86b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:22.986204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f236ba3-0226-4c51-953c-9259b6dfc86b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:22.986474 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f236ba3-0226-4c51-953c-9259b6dfc86b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:22.992601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f236ba3-0226-4c51-953c-9259b6dfc86b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:22.992732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 124/244] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:22.992837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f236ba3-0226-4c51-953c-9259b6dfc86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:22.992918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7a840-5716-451d-978a-ffb9f1fbb141 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:22.992994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f236ba3-0226-4c51-953c-9259b6dfc86b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.004676 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 121/245] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.005139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7a840-5716-451d-978a-ffb9f1fbb141 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.006574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f236ba3-0226-4c51-953c-9259b6dfc86b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.015951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7851f1-7313-42ba-a11a-ce32f86237ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.016665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7851f1-7313-42ba-a11a-ce32f86237ad admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.016946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7851f1-7313-42ba-a11a-ce32f86237ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.017218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7851f1-7313-42ba-a11a-ce32f86237ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.017979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7851f1-7313-42ba-a11a-ce32f86237ad admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:23.018278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7851f1-7313-42ba-a11a-ce32f86237ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.018622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f236ba3-0226-4c51-953c-9259b6dfc86b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.019893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7851f1-7313-42ba-a11a-ce32f86237ad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.023600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef63f2-2a03-48fc-9636-773da54a41c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.024245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef63f2-2a03-48fc-9636-773da54a41c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.024572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef63f2-2a03-48fc-9636-773da54a41c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.024849 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef63f2-2a03-48fc-9636-773da54a41c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.025606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef63f2-2a03-48fc-9636-773da54a41c1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:23.025910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef63f2-2a03-48fc-9636-773da54a41c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.027497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef63f2-2a03-48fc-9636-773da54a41c1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.028616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 125/246] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.029366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7851f1-7313-42ba-a11a-ce32f86237ad admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.037058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 122/247] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.037809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef63f2-2a03-48fc-9636-773da54a41c1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.044380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7851f1-7313-42ba-a11a-ce32f86237ad admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.048574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef63f2-2a03-48fc-9636-773da54a41c1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.048758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f85a6d-1959-4a8d-9df0-5e6dec286833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.049634 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f85a6d-1959-4a8d-9df0-5e6dec286833 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.049846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f85a6d-1959-4a8d-9df0-5e6dec286833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.050115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f85a6d-1959-4a8d-9df0-5e6dec286833 admin admin] PATH_INFO: `/v3/users/08b1ed4e2ded4493880aa67fa5866b42` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.051300 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f85a6d-1959-4a8d-9df0-5e6dec286833 admin admin] RBAC: Authorizing `identity:get_user(user_id=08b1ed4e2ded4493880aa67fa5866b42)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.053355 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b20620-bb64-4e6e-98fc-c62bd275ec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.053547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f85a6d-1959-4a8d-9df0-5e6dec286833 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.054179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b20620-bb64-4e6e-98fc-c62bd275ec41 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.055045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b20620-bb64-4e6e-98fc-c62bd275ec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.055308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b20620-bb64-4e6e-98fc-c62bd275ec41 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.055812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 126/248] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/users/08b1ed4e2ded4493880aa67fa5866b42 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.057357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f85a6d-1959-4a8d-9df0-5e6dec286833 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.066593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b20620-bb64-4e6e-98fc-c62bd275ec41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:23.067702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f85a6d-1959-4a8d-9df0-5e6dec286833 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.072196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e3e6b-de2e-4cac-a2ce-9b482dba7797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.073275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e3e6b-de2e-4cac-a2ce-9b482dba7797 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.073516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b5b20620-bb64-4e6e-98fc-c62bd275ec41 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:23.073936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e3e6b-de2e-4cac-a2ce-9b482dba7797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.074406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e3e6b-de2e-4cac-a2ce-9b482dba7797 admin admin] PATH_INFO: `/v3/users/78561292c9f242e8acfdbb1f6c67be6a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.079362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 123/249] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:23.079362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b20620-bb64-4e6e-98fc-c62bd275ec41 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.088665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b20620-bb64-4e6e-98fc-c62bd275ec41 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.092946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e3e6b-de2e-4cac-a2ce-9b482dba7797 admin admin] RBAC: Authorizing `identity:get_user(user_id=78561292c9f242e8acfdbb1f6c67be6a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.093133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01730c-84e7-43be-bcc3-f4218765acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.093934 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01730c-84e7-43be-bcc3-f4218765acff admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.094212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01730c-84e7-43be-bcc3-f4218765acff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.094482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01730c-84e7-43be-bcc3-f4218765acff admin admin] PATH_INFO: `/v3/users/08b1ed4e2ded4493880aa67fa5866b42` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.095071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e3e6b-de2e-4cac-a2ce-9b482dba7797 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.095694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01730c-84e7-43be-bcc3-f4218765acff admin admin] RBAC: Authorizing `identity:get_user(user_id=08b1ed4e2ded4493880aa67fa5866b42)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.101836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 127/250] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/users/78561292c9f242e8acfdbb1f6c67be6a => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.101836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e3e6b-de2e-4cac-a2ce-9b482dba7797 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.102028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01730c-84e7-43be-bcc3-f4218765acff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.102028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 124/251] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/users/08b1ed4e2ded4493880aa67fa5866b42 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.102028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01730c-84e7-43be-bcc3-f4218765acff admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.111148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01730c-84e7-43be-bcc3-f4218765acff admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.113102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e3e6b-de2e-4cac-a2ce-9b482dba7797 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.115464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cacafb-8b5c-4d74-a58a-61df79c02fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.116116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cacafb-8b5c-4d74-a58a-61df79c02fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.116458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cacafb-8b5c-4d74-a58a-61df79c02fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.116671 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cacafb-8b5c-4d74-a58a-61df79c02fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.117981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cacafb-8b5c-4d74-a58a-61df79c02fb7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:23.118077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd431-f83e-4890-8c4b-ccda2982fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.118286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cacafb-8b5c-4d74-a58a-61df79c02fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.118679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd431-f83e-4890-8c4b-ccda2982fa93 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.118953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd431-f83e-4890-8c4b-ccda2982fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.119226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd431-f83e-4890-8c4b-ccda2982fa93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.119830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cacafb-8b5c-4d74-a58a-61df79c02fb7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.126977 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd431-f83e-4890-8c4b-ccda2982fa93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.133424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd431-f83e-4890-8c4b-ccda2982fa93 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.133548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 125/252] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.133548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cacafb-8b5c-4d74-a58a-61df79c02fb7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.137747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 128/253] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:23.141252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd431-f83e-4890-8c4b-ccda2982fa93 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.144025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cacafb-8b5c-4d74-a58a-61df79c02fb7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.148555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a32bb-974e-4ef4-89ed-4f1da83063c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.149192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a32bb-974e-4ef4-89ed-4f1da83063c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.149478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a32bb-974e-4ef4-89ed-4f1da83063c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.149893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a32bb-974e-4ef4-89ed-4f1da83063c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.151237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd431-f83e-4890-8c4b-ccda2982fa93 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.155519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647034a-ea1f-48ff-bbe1-87427af3943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.156129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647034a-ea1f-48ff-bbe1-87427af3943c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.156426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647034a-ea1f-48ff-bbe1-87427af3943c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.156698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647034a-ea1f-48ff-bbe1-87427af3943c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.158028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a32bb-974e-4ef4-89ed-4f1da83063c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.159789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a32bb-974e-4ef4-89ed-4f1da83063c6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.164919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647034a-ea1f-48ff-bbe1-87427af3943c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.166645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647034a-ea1f-48ff-bbe1-87427af3943c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.169378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 126/254] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:23.170201 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a32bb-974e-4ef4-89ed-4f1da83063c6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.181581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 129/255] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:23.181581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647034a-ea1f-48ff-bbe1-87427af3943c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.183053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a32bb-974e-4ef4-89ed-4f1da83063c6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.187367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b3e15-de03-4f5c-87d6-daffbe356845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.187677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647034a-ea1f-48ff-bbe1-87427af3943c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.188219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b3e15-de03-4f5c-87d6-daffbe356845 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.188536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b3e15-de03-4f5c-87d6-daffbe356845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.188812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b3e15-de03-4f5c-87d6-daffbe356845 admin admin] PATH_INFO: `/v3/users/e105c16d19e44bdfbe1944c3bcd4a54c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.189988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b3e15-de03-4f5c-87d6-daffbe356845 admin admin] RBAC: Authorizing `identity:get_user(user_id=e105c16d19e44bdfbe1944c3bcd4a54c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.191975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa96d7-c962-469b-8faa-a9db79b0f0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.192074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b3e15-de03-4f5c-87d6-daffbe356845 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.192827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa96d7-c962-469b-8faa-a9db79b0f0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.193106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa96d7-c962-469b-8faa-a9db79b0f0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.193376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa96d7-c962-469b-8faa-a9db79b0f0f6 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.193683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 127/256] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/users/e105c16d19e44bdfbe1944c3bcd4a54c => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.194413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b3e15-de03-4f5c-87d6-daffbe356845 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.198785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa96d7-c962-469b-8faa-a9db79b0f0f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.200823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa96d7-c962-469b-8faa-a9db79b0f0f6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.205046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 130/257] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.205046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8938-e364-4151-9724-cbd691ed053c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.205046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8938-e364-4151-9724-cbd691ed053c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.205046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8938-e364-4151-9724-cbd691ed053c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.206464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 131/258] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:23.207883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b3e15-de03-4f5c-87d6-daffbe356845 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.208197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8938-e364-4151-9724-cbd691ed053c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.213107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ec615-3080-46a8-b2d2-6503bd45be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.213920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ec615-3080-46a8-b2d2-6503bd45be83 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.214201 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ec615-3080-46a8-b2d2-6503bd45be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.214473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ec615-3080-46a8-b2d2-6503bd45be83 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.215662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ec615-3080-46a8-b2d2-6503bd45be83 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.217731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ec615-3080-46a8-b2d2-6503bd45be83 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.219382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 128/259] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.220136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8938-e364-4151-9724-cbd691ed053c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.220243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ec615-3080-46a8-b2d2-6503bd45be83 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.224332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc818ea4-b332-4cd1-b455-f86071d4f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.225154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc818ea4-b332-4cd1-b455-f86071d4f221 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.225431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc818ea4-b332-4cd1-b455-f86071d4f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.225697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc818ea4-b332-4cd1-b455-f86071d4f221 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.227492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc818ea4-b332-4cd1-b455-f86071d4f221 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.229510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc818ea4-b332-4cd1-b455-f86071d4f221 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.229984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ec615-3080-46a8-b2d2-6503bd45be83 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.231133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 132/260] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.231843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc818ea4-b332-4cd1-b455-f86071d4f221 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.234368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cfefb-58c9-478c-97ab-fa8f5b6f67eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.235147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cfefb-58c9-478c-97ab-fa8f5b6f67eb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.235505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cfefb-58c9-478c-97ab-fa8f5b6f67eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.235854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cfefb-58c9-478c-97ab-fa8f5b6f67eb admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.237038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cfefb-58c9-478c-97ab-fa8f5b6f67eb admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.238994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cfefb-58c9-478c-97ab-fa8f5b6f67eb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.240650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 129/261] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.241905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12974e1e-76ea-4f76-b1a9-c6745cdf56c4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.242187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12974e1e-76ea-4f76-b1a9-c6745cdf56c4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.242461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12974e1e-76ea-4f76-b1a9-c6745cdf56c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.245129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc818ea4-b332-4cd1-b455-f86071d4f221 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.249478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe529e-6253-4b17-9e0f-4defc3c76d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.250121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe529e-6253-4b17-9e0f-4defc3c76d67 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.250401 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe529e-6253-4b17-9e0f-4defc3c76d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.250676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe529e-6253-4b17-9e0f-4defc3c76d67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.251498 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe529e-6253-4b17-9e0f-4defc3c76d67 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf, user.id=08b1ed4e2ded4493880aa67fa5866b42) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:23.251808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe529e-6253-4b17-9e0f-4defc3c76d67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.253660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe529e-6253-4b17-9e0f-4defc3c76d67 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.259311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-12974e1e-76ea-4f76-b1a9-c6745cdf56c4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:23.263182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 133/262] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/role_assignments?user.id=08b1ed4e2ded4493880aa67fa5866b42&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.263182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe529e-6253-4b17-9e0f-4defc3c76d67 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.263381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-12974e1e-76ea-4f76-b1a9-c6745cdf56c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:23.269584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe529e-6253-4b17-9e0f-4defc3c76d67 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.269808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 130/263] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:23.270498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12974e1e-76ea-4f76-b1a9-c6745cdf56c4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.281339 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12974e1e-76ea-4f76-b1a9-c6745cdf56c4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.282635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5889b6-8d91-4942-8782-33647d1df204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.283630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5889b6-8d91-4942-8782-33647d1df204 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.283929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5889b6-8d91-4942-8782-33647d1df204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.284309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5889b6-8d91-4942-8782-33647d1df204 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.285287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5889b6-8d91-4942-8782-33647d1df204 admin admin] RBAC: Adding query filter params (role.id=e2ec2f293cf340b3b7aca8230c9b877a, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf, user.id=78561292c9f242e8acfdbb1f6c67be6a) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:23.285669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5889b6-8d91-4942-8782-33647d1df204 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.289522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5889b6-8d91-4942-8782-33647d1df204 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.294442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2db9d-301f-4689-a5fc-61655dcc4290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.295429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2db9d-301f-4689-a5fc-61655dcc4290 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.296125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2db9d-301f-4689-a5fc-61655dcc4290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.296679 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2db9d-301f-4689-a5fc-61655dcc4290 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.297853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2db9d-301f-4689-a5fc-61655dcc4290 admin admin] RBAC: Adding query filter params (role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf, user.id=08b1ed4e2ded4493880aa67fa5866b42) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:23.298392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2db9d-301f-4689-a5fc-61655dcc4290 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.298779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 134/264] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/role_assignments?user.id=78561292c9f242e8acfdbb1f6c67be6a&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=e2ec2f293cf340b3b7aca8230c9b877a => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.299761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5889b6-8d91-4942-8782-33647d1df204 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.301280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2db9d-301f-4689-a5fc-61655dcc4290 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.310221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 131/265] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/role_assignments?user.id=08b1ed4e2ded4493880aa67fa5866b42&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.311802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2db9d-301f-4689-a5fc-61655dcc4290 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.311913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5889b6-8d91-4942-8782-33647d1df204 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.315806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45287458-6fb6-4c49-9e72-b7f462e3d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.316755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45287458-6fb6-4c49-9e72-b7f462e3d8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.317033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45287458-6fb6-4c49-9e72-b7f462e3d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.317305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45287458-6fb6-4c49-9e72-b7f462e3d8d9 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/users/e105c16d19e44bdfbe1944c3bcd4a54c/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.319407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45287458-6fb6-4c49-9e72-b7f462e3d8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1177859f1c41a78c7659b4df5f0dbf, user_id=e105c16d19e44bdfbe1944c3bcd4a54c, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.321531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2db9d-301f-4689-a5fc-61655dcc4290 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.322539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45287458-6fb6-4c49-9e72-b7f462e3d8d9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.327615 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa16979-7a63-4c9a-9674-db9922902270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.328473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa16979-7a63-4c9a-9674-db9922902270 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.328757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa16979-7a63-4c9a-9674-db9922902270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.329028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa16979-7a63-4c9a-9674-db9922902270 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.330689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa16979-7a63-4c9a-9674-db9922902270 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.332889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa16979-7a63-4c9a-9674-db9922902270 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.335114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 132/266] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:23.348390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa16979-7a63-4c9a-9674-db9922902270 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:23.354066 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 135/267] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:23 2022] PUT /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/users/e105c16d19e44bdfbe1944c3bcd4a54c/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:23.363316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa16979-7a63-4c9a-9674-db9922902270 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:23.434203 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb6901-29c9-47d5-8d72-8a627bb8f939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:23.434876 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb6901-29c9-47d5-8d72-8a627bb8f939 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:23.435223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb6901-29c9-47d5-8d72-8a627bb8f939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:23.435563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb6901-29c9-47d5-8d72-8a627bb8f939 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:23.436332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb6901-29c9-47d5-8d72-8a627bb8f939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:23.438514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb6901-29c9-47d5-8d72-8a627bb8f939 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:23.465017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 133/268] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:23 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:25.599183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24e6a-4e98-4a10-99e2-043087ef0a29 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.599711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24e6a-4e98-4a10-99e2-043087ef0a29 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.599711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24e6a-4e98-4a10-99e2-043087ef0a29 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.601964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 136/269] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:25.607965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e6d3-bb79-47f5-861c-4d9fd150aafc None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.608498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e6d3-bb79-47f5-861c-4d9fd150aafc None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.608570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179e6d3-bb79-47f5-861c-4d9fd150aafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.634875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2179e6d3-bb79-47f5-861c-4d9fd150aafc None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:25.636110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2179e6d3-bb79-47f5-861c-4d9fd150aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:25.644318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 134/270] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:25.667458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24e6a-4e98-4a10-99e2-043087ef0a29 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:25.685266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24e6a-4e98-4a10-99e2-043087ef0a29 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:25.689658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b9316-8d27-4592-b2ea-27dbc28bea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:25.690448 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b9316-8d27-4592-b2ea-27dbc28bea66 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.690727 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b9316-8d27-4592-b2ea-27dbc28bea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.690999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b9316-8d27-4592-b2ea-27dbc28bea66 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.702725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b9316-8d27-4592-b2ea-27dbc28bea66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:25.709581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-385b9316-8d27-4592-b2ea-27dbc28bea66 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 02:28:25.710799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 137/271] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:25.716730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179e6d3-bb79-47f5-861c-4d9fd150aafc None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:25.725877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179e6d3-bb79-47f5-861c-4d9fd150aafc None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:25.730797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896cd4-73ce-4230-9894-f9d8bb3eab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:25.731472 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896cd4-73ce-4230-9894-f9d8bb3eab2c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.731750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896cd4-73ce-4230-9894-f9d8bb3eab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.732019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8896cd4-73ce-4230-9894-f9d8bb3eab2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.732897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8896cd4-73ce-4230-9894-f9d8bb3eab2c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:25.733207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8896cd4-73ce-4230-9894-f9d8bb3eab2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:25.734726 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0407-8ce7-4a49-8090-387bf92aa076 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.734862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8896cd4-73ce-4230-9894-f9d8bb3eab2c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:25.735265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0407-8ce7-4a49-8090-387bf92aa076 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.735676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db0407-8ce7-4a49-8090-387bf92aa076 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.737623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 138/272] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:25.743220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc8cd4-ca52-4e8c-9663-cdd01a3b7d18 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.743675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc8cd4-ca52-4e8c-9663-cdd01a3b7d18 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.744084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc8cd4-ca52-4e8c-9663-cdd01a3b7d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.748433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 135/273] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:25.750756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896cd4-73ce-4230-9894-f9d8bb3eab2c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:25.762069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8896cd4-73ce-4230-9894-f9d8bb3eab2c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:25.766797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3587a-1137-4621-8335-05c0a2ad6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:25.767652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3587a-1137-4621-8335-05c0a2ad6f55 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.767928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3587a-1137-4621-8335-05c0a2ad6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.768196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3587a-1137-4621-8335-05c0a2ad6f55 admin admin] PATH_INFO: `/v3/users/78561292c9f242e8acfdbb1f6c67be6a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.769466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3587a-1137-4621-8335-05c0a2ad6f55 admin admin] RBAC: Authorizing `identity:get_user(user_id=78561292c9f242e8acfdbb1f6c67be6a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:25.771558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3587a-1137-4621-8335-05c0a2ad6f55 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:25.777711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 136/274] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:25 2022] GET /identity/v3/users/78561292c9f242e8acfdbb1f6c67be6a => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:25.779133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d3fc8cd4-ca52-4e8c-9663-cdd01a3b7d18 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:25.779385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3587a-1137-4621-8335-05c0a2ad6f55 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:25.780499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d3fc8cd4-ca52-4e8c-9663-cdd01a3b7d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:25.788616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 139/275] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:25.791135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3587a-1137-4621-8335-05c0a2ad6f55 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:25.795916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c410b8-f4ab-4aac-b5a6-b956d2c87da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:25.797002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c410b8-f4ab-4aac-b5a6-b956d2c87da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.797481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c410b8-f4ab-4aac-b5a6-b956d2c87da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.797987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c410b8-f4ab-4aac-b5a6-b956d2c87da4 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.799368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c410b8-f4ab-4aac-b5a6-b956d2c87da4 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:25.801620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c410b8-f4ab-4aac-b5a6-b956d2c87da4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:25.808440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 137/276] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:25 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:25.810080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc8cd4-ca52-4e8c-9663-cdd01a3b7d18 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:25.813290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c410b8-f4ab-4aac-b5a6-b956d2c87da4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:25.822081 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc8cd4-ca52-4e8c-9663-cdd01a3b7d18 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:25.823325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c410b8-f4ab-4aac-b5a6-b956d2c87da4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:25.827860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b369-7e20-4f2c-9676-db5ff65d539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:25.828186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46aa64-4f7c-43eb-b96c-137b5a3a8880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:25.828670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b369-7e20-4f2c-9676-db5ff65d539d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.828941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b369-7e20-4f2c-9676-db5ff65d539d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.829218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b369-7e20-4f2c-9676-db5ff65d539d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.830328 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46aa64-4f7c-43eb-b96c-137b5a3a8880 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.830819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46aa64-4f7c-43eb-b96c-137b5a3a8880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.831435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46aa64-4f7c-43eb-b96c-137b5a3a8880 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/users/78561292c9f242e8acfdbb1f6c67be6a/roles/e2ec2f293cf340b3b7aca8230c9b877a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.833955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46aa64-4f7c-43eb-b96c-137b5a3a8880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1177859f1c41a78c7659b4df5f0dbf, user_id=78561292c9f242e8acfdbb1f6c67be6a, role_id=e2ec2f293cf340b3b7aca8230c9b877a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:25.837759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46aa64-4f7c-43eb-b96c-137b5a3a8880 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:25.839855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4b369-7e20-4f2c-9676-db5ff65d539d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:25.846779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0ff4b369-7e20-4f2c-9676-db5ff65d539d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:25.848410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 138/277] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:25.852867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 140/278] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:25 2022] PUT /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/users/78561292c9f242e8acfdbb1f6c67be6a/roles/e2ec2f293cf340b3b7aca8230c9b877a => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:25.854443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b369-7e20-4f2c-9676-db5ff65d539d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:25.869695 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b369-7e20-4f2c-9676-db5ff65d539d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:25.891540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ed00d-3e9b-4c02-8a82-8e815e243a4c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.892163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ed00d-3e9b-4c02-8a82-8e815e243a4c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.892698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ed00d-3e9b-4c02-8a82-8e815e243a4c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.896317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 141/279] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:25.901161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec188eb-138e-43e1-95de-00f8061083c6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.901735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec188eb-138e-43e1-95de-00f8061083c6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.902234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec188eb-138e-43e1-95de-00f8061083c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.921794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fec188eb-138e-43e1-95de-00f8061083c6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:25.923336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fec188eb-138e-43e1-95de-00f8061083c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:25.937529 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbbc20-5584-4128-8728-c8539303a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:25.938283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbbc20-5584-4128-8728-c8539303a7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.938541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbbc20-5584-4128-8728-c8539303a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.938817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbbc20-5584-4128-8728-c8539303a7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.939580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbbc20-5584-4128-8728-c8539303a7a9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:25.939887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbbc20-5584-4128-8728-c8539303a7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:25.941593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbbc20-5584-4128-8728-c8539303a7a9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:25.951328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 139/280] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:25.957262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37967a-ed90-449b-91a1-c598d54f9d15 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.957553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37967a-ed90-449b-91a1-c598d54f9d15 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.957829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37967a-ed90-449b-91a1-c598d54f9d15 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.959665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 140/281] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:25.960485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37967a-ed90-449b-91a1-c598d54f9d15 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:25.973150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37967a-ed90-449b-91a1-c598d54f9d15 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:25.978633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b7d87-05bc-498e-b960-d5d721b3d98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:25.979556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7d87-05bc-498e-b960-d5d721b3d98a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.979835 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7d87-05bc-498e-b960-d5d721b3d98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.980109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7d87-05bc-498e-b960-d5d721b3d98a admin admin] PATH_INFO: `/v3/users/e105c16d19e44bdfbe1944c3bcd4a54c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.981444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b7d87-05bc-498e-b960-d5d721b3d98a admin admin] RBAC: Authorizing `identity:get_user(user_id=e105c16d19e44bdfbe1944c3bcd4a54c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:25.983636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b7d87-05bc-498e-b960-d5d721b3d98a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:25.985409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 141/282] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:25 2022] GET /identity/v3/users/e105c16d19e44bdfbe1944c3bcd4a54c => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:25.990302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd56e-4dfb-4940-bd96-400cd4bc2c2d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:25.990302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd56e-4dfb-4940-bd96-400cd4bc2c2d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:25.990302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fd56e-4dfb-4940-bd96-400cd4bc2c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:25.994754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 142/283] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:25.995470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec188eb-138e-43e1-95de-00f8061083c6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:26.005219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec188eb-138e-43e1-95de-00f8061083c6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:26.009952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858853a6-c850-4e24-8ef8-29b31146d36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:26.010494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858853a6-c850-4e24-8ef8-29b31146d36d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:26.010772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858853a6-c850-4e24-8ef8-29b31146d36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:26.011046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858853a6-c850-4e24-8ef8-29b31146d36d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:26.016684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3b4fd56e-4dfb-4940-bd96-400cd4bc2c2d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:26.018759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3b4fd56e-4dfb-4940-bd96-400cd4bc2c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:26.020433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858853a6-c850-4e24-8ef8-29b31146d36d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:26.022273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858853a6-c850-4e24-8ef8-29b31146d36d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:26.029988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 142/284] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:26.031240 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd56e-4dfb-4940-bd96-400cd4bc2c2d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:26.035604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 143/285] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:26.042250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858853a6-c850-4e24-8ef8-29b31146d36d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:26.043593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fd56e-4dfb-4940-bd96-400cd4bc2c2d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:26.050006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ed88-a380-4137-8908-f27b8e970df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:26.050869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ed88-a380-4137-8908-f27b8e970df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:26.051237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ed88-a380-4137-8908-f27b8e970df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:26.051534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ed88-a380-4137-8908-f27b8e970df6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:26.052994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858853a6-c850-4e24-8ef8-29b31146d36d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:26.063831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce1df7-e391-4ed8-9e8e-6e3382d73097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:26.064734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce1df7-e391-4ed8-9e8e-6e3382d73097 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:26.065014 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce1df7-e391-4ed8-9e8e-6e3382d73097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:26.065349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce1df7-e391-4ed8-9e8e-6e3382d73097 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:26.066694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce1df7-e391-4ed8-9e8e-6e3382d73097 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:26.067530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046ed88-a380-4137-8908-f27b8e970df6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:26.068757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce1df7-e391-4ed8-9e8e-6e3382d73097 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:26.070725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 144/286] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:26 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:26.071317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce1df7-e391-4ed8-9e8e-6e3382d73097 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:26.075277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b046ed88-a380-4137-8908-f27b8e970df6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:26.076878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 143/287] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:26.077588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ed88-a380-4137-8908-f27b8e970df6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:26.084121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce1df7-e391-4ed8-9e8e-6e3382d73097 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:26.087151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ed88-a380-4137-8908-f27b8e970df6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:26.088643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27aa7-858d-411a-9dad-eb9805db9b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:26.089410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27aa7-858d-411a-9dad-eb9805db9b74 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:26.089690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27aa7-858d-411a-9dad-eb9805db9b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:26.089961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27aa7-858d-411a-9dad-eb9805db9b74 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:26.091100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27aa7-858d-411a-9dad-eb9805db9b74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:26.091579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622af03-c58f-4405-ac92-6c12a2f93b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:26.092202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622af03-c58f-4405-ac92-6c12a2f93b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:26.092517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622af03-c58f-4405-ac92-6c12a2f93b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:26.092790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622af03-c58f-4405-ac92-6c12a2f93b33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:26.092880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27aa7-858d-411a-9dad-eb9805db9b74 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:26.093622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622af03-c58f-4405-ac92-6c12a2f93b33 admin admin] RBAC: Adding query filter params (role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf, user.id=e105c16d19e44bdfbe1944c3bcd4a54c) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:26.093931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622af03-c58f-4405-ac92-6c12a2f93b33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:26.094522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 145/288] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:26.095123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27aa7-858d-411a-9dad-eb9805db9b74 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:26.095905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622af03-c58f-4405-ac92-6c12a2f93b33 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:26.104170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 144/289] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:26 2022] GET /identity/v3/role_assignments?user.id=e105c16d19e44bdfbe1944c3bcd4a54c&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:26.104707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27aa7-858d-411a-9dad-eb9805db9b74 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:26.104961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622af03-c58f-4405-ac92-6c12a2f93b33 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:26.109248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f424139-7671-4e8a-979a-118b1eceef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:26.109911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f424139-7671-4e8a-979a-118b1eceef12 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:26.110187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f424139-7671-4e8a-979a-118b1eceef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:26.110461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f424139-7671-4e8a-979a-118b1eceef12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:26.111225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f424139-7671-4e8a-979a-118b1eceef12 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:26.111527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f424139-7671-4e8a-979a-118b1eceef12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:26.113187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f424139-7671-4e8a-979a-118b1eceef12 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:26.114794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622af03-c58f-4405-ac92-6c12a2f93b33 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:26.120457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2346c-3931-4bc6-92dd-63357d33b848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:26.121201 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2346c-3931-4bc6-92dd-63357d33b848 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:26.121534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2346c-3931-4bc6-92dd-63357d33b848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:26.121815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2346c-3931-4bc6-92dd-63357d33b848 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:26.122606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2346c-3931-4bc6-92dd-63357d33b848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:26.124714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 146/290] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:26.124855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2346c-3931-4bc6-92dd-63357d33b848 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:26.140393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f424139-7671-4e8a-979a-118b1eceef12 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:26.147686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 145/291] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:26 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:26.159042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f424139-7671-4e8a-979a-118b1eceef12 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:26.165063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3a43f-faee-4b72-8ee3-dd270712c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:26.166047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3a43f-faee-4b72-8ee3-dd270712c069 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:26.166329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3a43f-faee-4b72-8ee3-dd270712c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:26.166664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3a43f-faee-4b72-8ee3-dd270712c069 admin admin] PATH_INFO: `/v3/users/45b2d7a3525c4025b029520809cfed02` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:26.184611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3a43f-faee-4b72-8ee3-dd270712c069 admin admin] RBAC: Authorizing `identity:get_user(user_id=45b2d7a3525c4025b029520809cfed02)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:26.187126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3a43f-faee-4b72-8ee3-dd270712c069 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:26.189280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 147/292] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:26 2022] GET /identity/v3/users/45b2d7a3525c4025b029520809cfed02 => generated 293 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:26.195374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2346c-3931-4bc6-92dd-63357d33b848 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:26.206742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2346c-3931-4bc6-92dd-63357d33b848 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:26.212335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bfabb-f865-403d-9860-c280ae333b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:26.213114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfabb-f865-403d-9860-c280ae333b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:26.213396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfabb-f865-403d-9860-c280ae333b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:26.213670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bfabb-f865-403d-9860-c280ae333b71 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:26.214613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bfabb-f865-403d-9860-c280ae333b71 admin admin] RBAC: Adding query filter params (role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, user.id=45b2d7a3525c4025b029520809cfed02, scope.system=all) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:26.214981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bfabb-f865-403d-9860-c280ae333b71 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:26.217398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bfabb-f865-403d-9860-c280ae333b71 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:26.228372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 146/293] 10.222.0.15 () {56 vars in 1329 bytes} [Mon Feb 7 02:28:26 2022] GET /identity/v3/role_assignments?user.id=45b2d7a3525c4025b029520809cfed02&scope.system=all&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:28.115343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8fae-2b39-4101-aa57-cc4dff456f89 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.116080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8fae-2b39-4101-aa57-cc4dff456f89 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.116080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce8fae-2b39-4101-aa57-cc4dff456f89 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.118457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 148/294] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:28.123866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830674-68cf-4f71-8ab2-7691f40d0a0c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.124412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830674-68cf-4f71-8ab2-7691f40d0a0c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.124567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830674-68cf-4f71-8ab2-7691f40d0a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.142089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-eb830674-68cf-4f71-8ab2-7691f40d0a0c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:28.143274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-eb830674-68cf-4f71-8ab2-7691f40d0a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:28.151171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 147/295] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:28.175096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce8fae-2b39-4101-aa57-cc4dff456f89 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.188555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce8fae-2b39-4101-aa57-cc4dff456f89 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.193130 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e24a0-1f16-46b9-8b5e-85bca35ad6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.193939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e24a0-1f16-46b9-8b5e-85bca35ad6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.194216 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e24a0-1f16-46b9-8b5e-85bca35ad6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.194489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e24a0-1f16-46b9-8b5e-85bca35ad6ba admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.206450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e24a0-1f16-46b9-8b5e-85bca35ad6ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:28.213376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-bb7e24a0-1f16-46b9-8b5e-85bca35ad6ba admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 02:28:28.214584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 149/296] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:28.220293 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb830674-68cf-4f71-8ab2-7691f40d0a0c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.229930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb830674-68cf-4f71-8ab2-7691f40d0a0c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.234446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da548c29-f19d-46d8-bc4b-f513a1532dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.235102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da548c29-f19d-46d8-bc4b-f513a1532dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.235379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da548c29-f19d-46d8-bc4b-f513a1532dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.235651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da548c29-f19d-46d8-bc4b-f513a1532dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.236447 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da548c29-f19d-46d8-bc4b-f513a1532dc0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:28.236751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da548c29-f19d-46d8-bc4b-f513a1532dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.238345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da548c29-f19d-46d8-bc4b-f513a1532dc0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.247571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 148/297] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:28.252934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e24a0-1f16-46b9-8b5e-85bca35ad6ba admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.262564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e24a0-1f16-46b9-8b5e-85bca35ad6ba admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.266942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd867f-1b12-4fb8-8ba5-b933f5db4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.267791 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd867f-1b12-4fb8-8ba5-b933f5db4a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.268070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd867f-1b12-4fb8-8ba5-b933f5db4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.268356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd867f-1b12-4fb8-8ba5-b933f5db4a9f admin admin] PATH_INFO: `/v3/users/78561292c9f242e8acfdbb1f6c67be6a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.269583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd867f-1b12-4fb8-8ba5-b933f5db4a9f admin admin] RBAC: Authorizing `identity:get_user(user_id=78561292c9f242e8acfdbb1f6c67be6a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.271691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd867f-1b12-4fb8-8ba5-b933f5db4a9f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.273334 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 150/298] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/users/78561292c9f242e8acfdbb1f6c67be6a => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:28.278588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da548c29-f19d-46d8-bc4b-f513a1532dc0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.288322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da548c29-f19d-46d8-bc4b-f513a1532dc0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.293493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cb3df-4a7a-4d09-b06c-46a8d879f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.294173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb3df-4a7a-4d09-b06c-46a8d879f0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.294452 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb3df-4a7a-4d09-b06c-46a8d879f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.294727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb3df-4a7a-4d09-b06c-46a8d879f0d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.304774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cb3df-4a7a-4d09-b06c-46a8d879f0d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.306686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cb3df-4a7a-4d09-b06c-46a8d879f0d8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.317567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 149/299] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:28.323449 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd867f-1b12-4fb8-8ba5-b933f5db4a9f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.334379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd867f-1b12-4fb8-8ba5-b933f5db4a9f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.338907 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fca3c-49a4-49c9-bcb9-ef1418d10fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.339753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fca3c-49a4-49c9-bcb9-ef1418d10fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.340026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fca3c-49a4-49c9-bcb9-ef1418d10fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.340293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fca3c-49a4-49c9-bcb9-ef1418d10fb8 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.341513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fca3c-49a4-49c9-bcb9-ef1418d10fb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.343548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fca3c-49a4-49c9-bcb9-ef1418d10fb8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.345519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 151/300] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:28.351722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cb3df-4a7a-4d09-b06c-46a8d879f0d8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.360655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cb3df-4a7a-4d09-b06c-46a8d879f0d8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.365094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67accdd7-47a0-4668-9a02-95a8f34677ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.365783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67accdd7-47a0-4668-9a02-95a8f34677ff admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.366005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67accdd7-47a0-4668-9a02-95a8f34677ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.366277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67accdd7-47a0-4668-9a02-95a8f34677ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.367699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67accdd7-47a0-4668-9a02-95a8f34677ff admin admin] RBAC: Adding query filter params (role.id=e2ec2f293cf340b3b7aca8230c9b877a, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf, user.id=78561292c9f242e8acfdbb1f6c67be6a) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:28.368005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67accdd7-47a0-4668-9a02-95a8f34677ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.369857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67accdd7-47a0-4668-9a02-95a8f34677ff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.375884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 150/301] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/role_assignments?user.id=78561292c9f242e8acfdbb1f6c67be6a&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=e2ec2f293cf340b3b7aca8230c9b877a => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:28.477065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81501691-f136-4eeb-ac78-34c9c0fc3381 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.477065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81501691-f136-4eeb-ac78-34c9c0fc3381 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.477065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81501691-f136-4eeb-ac78-34c9c0fc3381 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.477930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 152/302] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:28.483760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707775ad-986f-4b48-a9a8-12e41a73ed84 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.484046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707775ad-986f-4b48-a9a8-12e41a73ed84 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.484307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707775ad-986f-4b48-a9a8-12e41a73ed84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.502868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-707775ad-986f-4b48-a9a8-12e41a73ed84 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:28.504071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-707775ad-986f-4b48-a9a8-12e41a73ed84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:28.512321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 151/303] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:28.536051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81501691-f136-4eeb-ac78-34c9c0fc3381 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.549985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81501691-f136-4eeb-ac78-34c9c0fc3381 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.554235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa44d0-4099-4f93-bdf2-5ea37c08e9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.555017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa44d0-4099-4f93-bdf2-5ea37c08e9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.555292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa44d0-4099-4f93-bdf2-5ea37c08e9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.555556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa44d0-4099-4f93-bdf2-5ea37c08e9f8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.565830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa44d0-4099-4f93-bdf2-5ea37c08e9f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:28.572652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-30fa44d0-4099-4f93-bdf2-5ea37c08e9f8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:28.574079 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 153/304] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:28.579811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707775ad-986f-4b48-a9a8-12e41a73ed84 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.583685 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2735-6942-4dab-8eda-345485263975 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.583973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2735-6942-4dab-8eda-345485263975 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.584253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc2735-6942-4dab-8eda-345485263975 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.587076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 154/305] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:28.588220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522e952-f451-4f75-9090-afbaeed5c06c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.588542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522e952-f451-4f75-9090-afbaeed5c06c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.588818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522e952-f451-4f75-9090-afbaeed5c06c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.589614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707775ad-986f-4b48-a9a8-12e41a73ed84 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.590424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 155/306] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:28.592185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda30fa1-2e1f-49a6-8149-f1c76ecc9ae1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.592497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda30fa1-2e1f-49a6-8149-f1c76ecc9ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.592773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda30fa1-2e1f-49a6-8149-f1c76ecc9ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.594276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e215217-ea09-4061-80ef-054b5fc7111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.595125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e215217-ea09-4061-80ef-054b5fc7111e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.595416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e215217-ea09-4061-80ef-054b5fc7111e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.595681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e215217-ea09-4061-80ef-054b5fc7111e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.596473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e215217-ea09-4061-80ef-054b5fc7111e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:28.596777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e215217-ea09-4061-80ef-054b5fc7111e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.598362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e215217-ea09-4061-80ef-054b5fc7111e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.608410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 152/307] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:28.609854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5044d2-5cb4-4b24-9d2b-1b198886e7df None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.610142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5044d2-5cb4-4b24-9d2b-1b198886e7df None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.610525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5044d2-5cb4-4b24-9d2b-1b198886e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.611218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-eda30fa1-2e1f-49a6-8149-f1c76ecc9ae1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:28.612503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-eda30fa1-2e1f-49a6-8149-f1c76ecc9ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:28.620517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 156/308] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:28.621302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda30fa1-2e1f-49a6-8149-f1c76ecc9ae1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.629106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-cf5044d2-5cb4-4b24-9d2b-1b198886e7df None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:28.630277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cf5044d2-5cb4-4b24-9d2b-1b198886e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:28.637997 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda30fa1-2e1f-49a6-8149-f1c76ecc9ae1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.640129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 153/309] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:28.645493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259b775-c2f9-4fe6-8c74-4fa2cd9a71bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.646352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259b775-c2f9-4fe6-8c74-4fa2cd9a71bb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.646631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259b775-c2f9-4fe6-8c74-4fa2cd9a71bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.646898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259b775-c2f9-4fe6-8c74-4fa2cd9a71bb admin admin] PATH_INFO: `/v3/users/45b2d7a3525c4025b029520809cfed02` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.648766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259b775-c2f9-4fe6-8c74-4fa2cd9a71bb admin admin] RBAC: Authorizing `identity:get_user(user_id=45b2d7a3525c4025b029520809cfed02)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.651365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259b775-c2f9-4fe6-8c74-4fa2cd9a71bb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.653537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5044d2-5cb4-4b24-9d2b-1b198886e7df None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.653653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 157/310] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/users/45b2d7a3525c4025b029520809cfed02 => generated 293 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:28.660696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259b775-c2f9-4fe6-8c74-4fa2cd9a71bb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.665615 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5044d2-5cb4-4b24-9d2b-1b198886e7df None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.670757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a39f4-188f-46d8-8949-f5a57c1d233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.671603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259b775-c2f9-4fe6-8c74-4fa2cd9a71bb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.671712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a39f4-188f-46d8-8949-f5a57c1d233c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.671883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a39f4-188f-46d8-8949-f5a57c1d233c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.672234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a39f4-188f-46d8-8949-f5a57c1d233c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.676499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa77b-7752-41cd-8bed-0d4476185253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.677352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa77b-7752-41cd-8bed-0d4476185253 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.677633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa77b-7752-41cd-8bed-0d4476185253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.677907 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fa77b-7752-41cd-8bed-0d4476185253 admin admin] PATH_INFO: `/v3/system/users/45b2d7a3525c4025b029520809cfed02/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.679520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fa77b-7752-41cd-8bed-0d4476185253 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=45b2d7a3525c4025b029520809cfed02, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.680633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-1c1fa77b-7752-41cd-8bed-0d4476185253 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:28.680633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:28:28.680633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:28:28.681507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fa77b-7752-41cd-8bed-0d4476185253 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.683459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a39f4-188f-46d8-8949-f5a57c1d233c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:28.690453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 158/311] 10.222.0.15 () {58 vars in 1355 bytes} [Mon Feb 7 02:28:28 2022] PUT /identity/v3/system/users/45b2d7a3525c4025b029520809cfed02/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:28:28.696591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ed6a39f4-188f-46d8-8949-f5a57c1d233c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 02:28:28.696705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa77b-7752-41cd-8bed-0d4476185253 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.696802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 154/312] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:28.697692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a39f4-188f-46d8-8949-f5a57c1d233c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.702268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fa77b-7752-41cd-8bed-0d4476185253 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.706963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ef2f-e145-4b7c-b0ce-1b77e32a00d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.707775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ef2f-e145-4b7c-b0ce-1b77e32a00d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.708053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ef2f-e145-4b7c-b0ce-1b77e32a00d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.708322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595ef2f-e145-4b7c-b0ce-1b77e32a00d3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.708860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a39f4-188f-46d8-8949-f5a57c1d233c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.709629 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595ef2f-e145-4b7c-b0ce-1b77e32a00d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.711942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595ef2f-e145-4b7c-b0ce-1b77e32a00d3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.713828 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 159/313] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:28.714533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c2fbb-d9b7-4e54-be42-a7385fbb19b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.715263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c2fbb-d9b7-4e54-be42-a7385fbb19b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.715623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c2fbb-d9b7-4e54-be42-a7385fbb19b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.715924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c2fbb-d9b7-4e54-be42-a7385fbb19b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.716811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c2fbb-d9b7-4e54-be42-a7385fbb19b0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:28.717122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c2fbb-d9b7-4e54-be42-a7385fbb19b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.719296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c2fbb-d9b7-4e54-be42-a7385fbb19b0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.719638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ef2f-e145-4b7c-b0ce-1b77e32a00d3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.730548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 155/314] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:28.731331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595ef2f-e145-4b7c-b0ce-1b77e32a00d3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.736086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed022a-094a-4b78-8002-00eac040f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.736255 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c2fbb-d9b7-4e54-be42-a7385fbb19b0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.736806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed022a-094a-4b78-8002-00eac040f696 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.737089 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed022a-094a-4b78-8002-00eac040f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.737357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed022a-094a-4b78-8002-00eac040f696 admin admin] PATH_INFO: `/v3/groups` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.738062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed022a-094a-4b78-8002-00eac040f696 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.739093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-77ed022a-094a-4b78-8002-00eac040f696 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:28.739093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:28:28.739093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:28:28.740327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed022a-094a-4b78-8002-00eac040f696 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.748652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c2fbb-d9b7-4e54-be42-a7385fbb19b0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.753554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036fc2c-2538-42fe-b7b4-df3310c6fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.754454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036fc2c-2538-42fe-b7b4-df3310c6fd8a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.754733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036fc2c-2538-42fe-b7b4-df3310c6fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.755011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036fc2c-2538-42fe-b7b4-df3310c6fd8a admin admin] PATH_INFO: `/v3/users/4bf167c5f8454e0c9f53650026759c59` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.759739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 160/315] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Feb 7 02:28:28 2022] POST /identity/v3/groups => generated 229 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:28:28.770790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036fc2c-2538-42fe-b7b4-df3310c6fd8a admin admin] RBAC: Authorizing `identity:get_user(user_id=4bf167c5f8454e0c9f53650026759c59)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.773640 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1036fc2c-2538-42fe-b7b4-df3310c6fd8a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.775718 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 156/316] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/users/4bf167c5f8454e0c9f53650026759c59 => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:28.781795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed022a-094a-4b78-8002-00eac040f696 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:28.793100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed022a-094a-4b78-8002-00eac040f696 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:28.797976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812025e-2986-4c5a-a6e0-40a5de828a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:28.798808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812025e-2986-4c5a-a6e0-40a5de828a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:28.799184 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812025e-2986-4c5a-a6e0-40a5de828a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:28.799575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812025e-2986-4c5a-a6e0-40a5de828a1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:28.800597 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812025e-2986-4c5a-a6e0-40a5de828a1f admin admin] RBAC: Adding query filter params (role.id=e2ec2f293cf340b3b7aca8230c9b877a, user.id=4bf167c5f8454e0c9f53650026759c59, scope.system=all) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:28.801013 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812025e-2986-4c5a-a6e0-40a5de828a1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:28.803028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812025e-2986-4c5a-a6e0-40a5de828a1f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:28.816407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 161/317] 10.222.0.15 () {56 vars in 1329 bytes} [Mon Feb 7 02:28:28 2022] GET /identity/v3/role_assignments?user.id=4bf167c5f8454e0c9f53650026759c59&scope.system=all&role.id=e2ec2f293cf340b3b7aca8230c9b877a => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:30.907926 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb238e2-6235-4706-bee5-97f5726d674f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:30.908627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb238e2-6235-4706-bee5-97f5726d674f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:30.908627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb238e2-6235-4706-bee5-97f5726d674f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:30.910450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 157/318] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:30.915453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca31d7c-1b52-4feb-82ca-0f481aa141ce None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:30.915864 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca31d7c-1b52-4feb-82ca-0f481aa141ce None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:30.916035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca31d7c-1b52-4feb-82ca-0f481aa141ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:30.934935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-aca31d7c-1b52-4feb-82ca-0f481aa141ce None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:30.936033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-aca31d7c-1b52-4feb-82ca-0f481aa141ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:30.943502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 162/319] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:30.969406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb238e2-6235-4706-bee5-97f5726d674f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:30.981343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb238e2-6235-4706-bee5-97f5726d674f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:30.985568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1c220-f12d-43a7-a104-a32f4f9a6dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:30.986340 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1c220-f12d-43a7-a104-a32f4f9a6dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:30.986617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1c220-f12d-43a7-a104-a32f4f9a6dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:30.986888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1c220-f12d-43a7-a104-a32f4f9a6dd7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:30.997927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1c220-f12d-43a7-a104-a32f4f9a6dd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:30.999993 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea74b3-91ac-457e-b502-8581d88004a6 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.000278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea74b3-91ac-457e-b502-8581d88004a6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.000585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea74b3-91ac-457e-b502-8581d88004a6 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.002473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 163/320] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:31.004974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-89d1c220-f12d-43a7-a104-a32f4f9a6dd7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:31.006231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 158/321] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:31.007919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6800c-48cc-40c1-8c7b-4441f791732d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.008202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6800c-48cc-40c1-8c7b-4441f791732d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.008520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6800c-48cc-40c1-8c7b-4441f791732d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.012442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1c220-f12d-43a7-a104-a32f4f9a6dd7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:31.023677 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1c220-f12d-43a7-a104-a32f4f9a6dd7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:31.028826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73683cb1-1577-4449-ba7e-bab728fe4270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:31.029347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c7c6800c-48cc-40c1-8c7b-4441f791732d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:31.029515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683cb1-1577-4449-ba7e-bab728fe4270 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.029870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683cb1-1577-4449-ba7e-bab728fe4270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.030173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73683cb1-1577-4449-ba7e-bab728fe4270 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.030439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c7c6800c-48cc-40c1-8c7b-4441f791732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:31.031016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73683cb1-1577-4449-ba7e-bab728fe4270 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:31.031334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73683cb1-1577-4449-ba7e-bab728fe4270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:31.033111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73683cb1-1577-4449-ba7e-bab728fe4270 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:31.038149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 164/322] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:31.039418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d086e7e-f770-4163-a226-f636e7f1a69a None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.039694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d086e7e-f770-4163-a226-f636e7f1a69a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.039967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d086e7e-f770-4163-a226-f636e7f1a69a None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.041799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 165/323] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:31.042515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 159/324] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:31.046807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb561e-1d42-42ca-8862-4ef452eea040 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.047092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb561e-1d42-42ca-8862-4ef452eea040 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.047368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb561e-1d42-42ca-8862-4ef452eea040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.048907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73683cb1-1577-4449-ba7e-bab728fe4270 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:31.060767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73683cb1-1577-4449-ba7e-bab728fe4270 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:31.065634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa01de-d8f7-4baf-9304-8913a1e062b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:31.066034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-abcb561e-1d42-42ca-8862-4ef452eea040 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:31.066497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa01de-d8f7-4baf-9304-8913a1e062b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.066778 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa01de-d8f7-4baf-9304-8913a1e062b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.067053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa01de-d8f7-4baf-9304-8913a1e062b7 admin admin] PATH_INFO: `/v3/users/45b2d7a3525c4025b029520809cfed02` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.067759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-abcb561e-1d42-42ca-8862-4ef452eea040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:31.068262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa01de-d8f7-4baf-9304-8913a1e062b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=45b2d7a3525c4025b029520809cfed02)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:31.071107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa01de-d8f7-4baf-9304-8913a1e062b7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:31.072819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 160/325] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:31 2022] GET /identity/v3/users/45b2d7a3525c4025b029520809cfed02 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:31.073425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa01de-d8f7-4baf-9304-8913a1e062b7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:31.078001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 166/326] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:31.079126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb561e-1d42-42ca-8862-4ef452eea040 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:31.084005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa01de-d8f7-4baf-9304-8913a1e062b7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:31.089165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb561e-1d42-42ca-8862-4ef452eea040 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:31.089522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84721bc3-4936-426c-85ca-8a912b9bc662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:31.090260 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84721bc3-4936-426c-85ca-8a912b9bc662 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.090538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84721bc3-4936-426c-85ca-8a912b9bc662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.090806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84721bc3-4936-426c-85ca-8a912b9bc662 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.091948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84721bc3-4936-426c-85ca-8a912b9bc662 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:31.093492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56195604-b672-4c65-929b-3bb2016f64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:31.093602 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84721bc3-4936-426c-85ca-8a912b9bc662 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:31.094111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56195604-b672-4c65-929b-3bb2016f64dc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.094385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56195604-b672-4c65-929b-3bb2016f64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.094654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56195604-b672-4c65-929b-3bb2016f64dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.099901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 161/327] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:31.100028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56195604-b672-4c65-929b-3bb2016f64dc admin admin] RBAC: Adding query filter params (role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, user.id=45b2d7a3525c4025b029520809cfed02, scope.system=all) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:31.100028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56195604-b672-4c65-929b-3bb2016f64dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:31.100028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56195604-b672-4c65-929b-3bb2016f64dc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:31.100269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84721bc3-4936-426c-85ca-8a912b9bc662 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:31.109698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84721bc3-4936-426c-85ca-8a912b9bc662 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:31.121029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 167/328] 10.222.0.15 () {56 vars in 1329 bytes} [Mon Feb 7 02:28:31 2022] GET /identity/v3/role_assignments?user.id=45b2d7a3525c4025b029520809cfed02&scope.system=all&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 510 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:31.121269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372339c6-2b07-4746-936c-ca8d06da9ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:31.121378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56195604-b672-4c65-929b-3bb2016f64dc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:31.121461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372339c6-2b07-4746-936c-ca8d06da9ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.121461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372339c6-2b07-4746-936c-ca8d06da9ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.121461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372339c6-2b07-4746-936c-ca8d06da9ecf admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.125116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56195604-b672-4c65-929b-3bb2016f64dc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:31.127819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372339c6-2b07-4746-936c-ca8d06da9ecf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:31.129581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dec22-0a18-4be2-b261-c15c97dfee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:31.130260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dec22-0a18-4be2-b261-c15c97dfee1f admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.130537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dec22-0a18-4be2-b261-c15c97dfee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.130812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dec22-0a18-4be2-b261-c15c97dfee1f admin admin] PATH_INFO: `/v3/groups` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.131521 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dec22-0a18-4be2-b261-c15c97dfee1f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:31.133550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dec22-0a18-4be2-b261-c15c97dfee1f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:31.134931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-372339c6-2b07-4746-936c-ca8d06da9ecf admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 02:28:31.136382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 162/329] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:31.142156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372339c6-2b07-4746-936c-ca8d06da9ecf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:31.151153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 168/330] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Feb 7 02:28:31 2022] POST /identity/v3/groups => generated 226 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:31.155890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372339c6-2b07-4746-936c-ca8d06da9ecf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:31.160768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed6156-84b9-41cb-a589-5e7a2e978e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:31.161538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed6156-84b9-41cb-a589-5e7a2e978e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.161890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed6156-84b9-41cb-a589-5e7a2e978e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.162240 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed6156-84b9-41cb-a589-5e7a2e978e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.163103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed6156-84b9-41cb-a589-5e7a2e978e33 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:31.164038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed6156-84b9-41cb-a589-5e7a2e978e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:31.165879 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed6156-84b9-41cb-a589-5e7a2e978e33 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:31.176285 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 163/331] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:31.182665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dec22-0a18-4be2-b261-c15c97dfee1f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:31.193331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dec22-0a18-4be2-b261-c15c97dfee1f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:31.198217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f67962-571e-4187-a215-5afabdb7a564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:31.199248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f67962-571e-4187-a215-5afabdb7a564 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.199594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f67962-571e-4187-a215-5afabdb7a564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.199938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f67962-571e-4187-a215-5afabdb7a564 admin admin] PATH_INFO: `/v3/users/4bf167c5f8454e0c9f53650026759c59` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.201650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f67962-571e-4187-a215-5afabdb7a564 admin admin] RBAC: Authorizing `identity:get_user(user_id=4bf167c5f8454e0c9f53650026759c59)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:31.203918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f67962-571e-4187-a215-5afabdb7a564 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:31.208399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 169/332] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:31 2022] GET /identity/v3/users/4bf167c5f8454e0c9f53650026759c59 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:31.212055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed6156-84b9-41cb-a589-5e7a2e978e33 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:31.223017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed6156-84b9-41cb-a589-5e7a2e978e33 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:31.228221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f06733-2b8d-4653-9b84-fd64888ec6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:31.229141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06733-2b8d-4653-9b84-fd64888ec6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:31.229421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06733-2b8d-4653-9b84-fd64888ec6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:31.229696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f06733-2b8d-4653-9b84-fd64888ec6c3 admin admin] PATH_INFO: `/v3/system/users/4bf167c5f8454e0c9f53650026759c59/roles/e2ec2f293cf340b3b7aca8230c9b877a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:31.231326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f06733-2b8d-4653-9b84-fd64888ec6c3 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4bf167c5f8454e0c9f53650026759c59, role_id=e2ec2f293cf340b3b7aca8230c9b877a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:31.232426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-c8f06733-2b8d-4653-9b84-fd64888ec6c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:31.232426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:28:31.232426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:28:31.233317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f06733-2b8d-4653-9b84-fd64888ec6c3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:31.242944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 164/333] 10.222.0.15 () {58 vars in 1355 bytes} [Mon Feb 7 02:28:31 2022] PUT /identity/v3/system/users/4bf167c5f8454e0c9f53650026759c59/roles/e2ec2f293cf340b3b7aca8230c9b877a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:33.740841 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45338f-2ee9-4b9f-9f12-0ee0b97f7613 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:33.742352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45338f-2ee9-4b9f-9f12-0ee0b97f7613 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:33.742846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45338f-2ee9-4b9f-9f12-0ee0b97f7613 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:33.745043 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 170/334] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:33.751144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824f922-c382-408b-9de7-93c2c8fb1122 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:33.751654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824f922-c382-408b-9de7-93c2c8fb1122 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:33.751758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824f922-c382-408b-9de7-93c2c8fb1122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:33.780822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6824f922-c382-408b-9de7-93c2c8fb1122 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:33.782033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6824f922-c382-408b-9de7-93c2c8fb1122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:33.795976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 165/335] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:33.837587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45338f-2ee9-4b9f-9f12-0ee0b97f7613 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:33.854028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45338f-2ee9-4b9f-9f12-0ee0b97f7613 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:33.861050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa35eb-b520-4f2d-9e4e-a6b4516d249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:33.861775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa35eb-b520-4f2d-9e4e-a6b4516d249d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:33.862050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa35eb-b520-4f2d-9e4e-a6b4516d249d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:33.862320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa35eb-b520-4f2d-9e4e-a6b4516d249d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:33.878460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa35eb-b520-4f2d-9e4e-a6b4516d249d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:33.886277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-96fa35eb-b520-4f2d-9e4e-a6b4516d249d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:33.887489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 171/336] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:33.893214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824f922-c382-408b-9de7-93c2c8fb1122 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:33.905410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824f922-c382-408b-9de7-93c2c8fb1122 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:33.917003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bb5c7-0f99-4243-99fa-4eda245830fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:33.917678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bb5c7-0f99-4243-99fa-4eda245830fb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:33.917949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bb5c7-0f99-4243-99fa-4eda245830fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:33.918215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bb5c7-0f99-4243-99fa-4eda245830fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:33.918986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bb5c7-0f99-4243-99fa-4eda245830fb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:33.919285 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bb5c7-0f99-4243-99fa-4eda245830fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:33.920906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bb5c7-0f99-4243-99fa-4eda245830fb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:33.934916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 166/337] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:33.940281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa35eb-b520-4f2d-9e4e-a6b4516d249d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:33.953601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa35eb-b520-4f2d-9e4e-a6b4516d249d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:33.964410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b128557-c8c7-4abd-8859-7ff6e4c37484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:33.965069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b128557-c8c7-4abd-8859-7ff6e4c37484 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:33.965357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b128557-c8c7-4abd-8859-7ff6e4c37484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:33.965634 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b128557-c8c7-4abd-8859-7ff6e4c37484 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:33.982635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b128557-c8c7-4abd-8859-7ff6e4c37484 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:33.984509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b128557-c8c7-4abd-8859-7ff6e4c37484 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:33.998553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 172/338] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:34.003854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bb5c7-0f99-4243-99fa-4eda245830fb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.017891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bb5c7-0f99-4243-99fa-4eda245830fb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.028171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569edd8-7686-4809-bb9c-5d6dfad0dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.029082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569edd8-7686-4809-bb9c-5d6dfad0dd30 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.029481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569edd8-7686-4809-bb9c-5d6dfad0dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.029645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569edd8-7686-4809-bb9c-5d6dfad0dd30 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.033696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569edd8-7686-4809-bb9c-5d6dfad0dd30 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.035760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569edd8-7686-4809-bb9c-5d6dfad0dd30 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.037869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 167/339] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:34.043434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b128557-c8c7-4abd-8859-7ff6e4c37484 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.056702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b128557-c8c7-4abd-8859-7ff6e4c37484 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.064271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934c0f6-4140-45a2-a58b-56223df04fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.065162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c0f6-4140-45a2-a58b-56223df04fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.065443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c0f6-4140-45a2-a58b-56223df04fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.065718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c0f6-4140-45a2-a58b-56223df04fa1 admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.079141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934c0f6-4140-45a2-a58b-56223df04fa1 admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.080183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-5934c0f6-4140-45a2-a58b-56223df04fa1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:34.080183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:28:34.080183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:28:34.081399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934c0f6-4140-45a2-a58b-56223df04fa1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.083123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 173/340] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:34.088971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569edd8-7686-4809-bb9c-5d6dfad0dd30 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.103838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569edd8-7686-4809-bb9c-5d6dfad0dd30 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.116289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ea057-ed6e-4644-95b2-60b966d2ff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.117727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ea057-ed6e-4644-95b2-60b966d2ff43 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.118003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ea057-ed6e-4644-95b2-60b966d2ff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.118272 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ea057-ed6e-4644-95b2-60b966d2ff43 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.119289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ea057-ed6e-4644-95b2-60b966d2ff43 admin admin] RBAC: Adding query filter params (group.id=a6cc840b90534145a91d05a0f98a7b3f, role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:34.119598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ea057-ed6e-4644-95b2-60b966d2ff43 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.124158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ea057-ed6e-4644-95b2-60b966d2ff43 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.137571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 168/341] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/role_assignments?group.id=a6cc840b90534145a91d05a0f98a7b3f&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:34.277665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7ef9-5d1c-46f7-a55e-c98ff9c6d1da None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.277992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7ef9-5d1c-46f7-a55e-c98ff9c6d1da None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.278221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a7ef9-5d1c-46f7-a55e-c98ff9c6d1da None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.279970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 174/342] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:34.286000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dcf84-0c28-4646-8423-18b7440ed159 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.286281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dcf84-0c28-4646-8423-18b7440ed159 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.286558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dcf84-0c28-4646-8423-18b7440ed159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.313362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d51dcf84-0c28-4646-8423-18b7440ed159 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:34.314551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d51dcf84-0c28-4646-8423-18b7440ed159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:34.323117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 169/343] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:34.370726 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7ef9-5d1c-46f7-a55e-c98ff9c6d1da None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.386801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a7ef9-5d1c-46f7-a55e-c98ff9c6d1da None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.396635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66091d04-576a-48c2-9f40-11d5c126eb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.397446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66091d04-576a-48c2-9f40-11d5c126eb39 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.398293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66091d04-576a-48c2-9f40-11d5c126eb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.398567 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66091d04-576a-48c2-9f40-11d5c126eb39 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.421342 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66091d04-576a-48c2-9f40-11d5c126eb39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:34.428467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-66091d04-576a-48c2-9f40-11d5c126eb39 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 07 02:28:34.430594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 175/344] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:34.436473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dcf84-0c28-4646-8423-18b7440ed159 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.450254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dcf84-0c28-4646-8423-18b7440ed159 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.466389 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb100bd8-7579-4e01-aee5-ec7db309681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.467091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb100bd8-7579-4e01-aee5-ec7db309681a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.467429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb100bd8-7579-4e01-aee5-ec7db309681a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.467699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb100bd8-7579-4e01-aee5-ec7db309681a admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.468516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb100bd8-7579-4e01-aee5-ec7db309681a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:34.468819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb100bd8-7579-4e01-aee5-ec7db309681a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.470480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb100bd8-7579-4e01-aee5-ec7db309681a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.490977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 170/345] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:34.497298 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66091d04-576a-48c2-9f40-11d5c126eb39 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.503788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373bb40-3fe6-4dfc-9f02-bcd5a55c06bd None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.504077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373bb40-3fe6-4dfc-9f02-bcd5a55c06bd None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.504333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373bb40-3fe6-4dfc-9f02-bcd5a55c06bd None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.507968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 171/346] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:34.510842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66091d04-576a-48c2-9f40-11d5c126eb39 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.514077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28054-0909-40e9-993b-8b49aa6b3977 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.514357 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28054-0909-40e9-993b-8b49aa6b3977 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.514629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b28054-0909-40e9-993b-8b49aa6b3977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.526992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daa997-63bb-48f6-9469-1491ed6c824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.526992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa997-63bb-48f6-9469-1491ed6c824c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.527454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa997-63bb-48f6-9469-1491ed6c824c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.527454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa997-63bb-48f6-9469-1491ed6c824c admin admin] PATH_INFO: `/v3/users/4bf167c5f8454e0c9f53650026759c59` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.533228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daa997-63bb-48f6-9469-1491ed6c824c admin admin] RBAC: Authorizing `identity:get_user(user_id=4bf167c5f8454e0c9f53650026759c59)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.535322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daa997-63bb-48f6-9469-1491ed6c824c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.535503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-49b28054-0909-40e9-993b-8b49aa6b3977 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:34.536576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-49b28054-0909-40e9-993b-8b49aa6b3977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:34.537230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 176/347] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/users/4bf167c5f8454e0c9f53650026759c59 => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:34.543645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daa997-63bb-48f6-9469-1491ed6c824c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.547344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 172/348] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:34.558093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daa997-63bb-48f6-9469-1491ed6c824c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.572994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34041ca8-0897-4b19-b45b-7096e317ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.573654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34041ca8-0897-4b19-b45b-7096e317ff50 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.573932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34041ca8-0897-4b19-b45b-7096e317ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.574210 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34041ca8-0897-4b19-b45b-7096e317ff50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.575055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34041ca8-0897-4b19-b45b-7096e317ff50 admin admin] RBAC: Adding query filter params (role.id=e2ec2f293cf340b3b7aca8230c9b877a, user.id=4bf167c5f8454e0c9f53650026759c59, scope.system=all) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:34.575363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34041ca8-0897-4b19-b45b-7096e317ff50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.577616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34041ca8-0897-4b19-b45b-7096e317ff50 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.580844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28054-0909-40e9-993b-8b49aa6b3977 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.594313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 177/349] 10.222.0.15 () {56 vars in 1329 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/role_assignments?user.id=4bf167c5f8454e0c9f53650026759c59&scope.system=all&role.id=e2ec2f293cf340b3b7aca8230c9b877a => generated 510 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:34.594841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b28054-0909-40e9-993b-8b49aa6b3977 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.603870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d7bed-095e-4bd5-a2ba-f2656ae9bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.604812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d7bed-095e-4bd5-a2ba-f2656ae9bf00 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.605094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d7bed-095e-4bd5-a2ba-f2656ae9bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.605365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d7bed-095e-4bd5-a2ba-f2656ae9bf00 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.629376 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d7bed-095e-4bd5-a2ba-f2656ae9bf00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:34.632996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ee1d7bed-095e-4bd5-a2ba-f2656ae9bf00 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:34.636859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 173/350] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:34.645016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34041ca8-0897-4b19-b45b-7096e317ff50 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.662280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34041ca8-0897-4b19-b45b-7096e317ff50 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.685179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beb506-87af-4f95-a841-f4f976a85c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.685878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb506-87af-4f95-a841-f4f976a85c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.686158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb506-87af-4f95-a841-f4f976a85c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.686434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beb506-87af-4f95-a841-f4f976a85c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.687208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beb506-87af-4f95-a841-f4f976a85c2a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:34.687513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beb506-87af-4f95-a841-f4f976a85c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.689197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beb506-87af-4f95-a841-f4f976a85c2a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.702874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 178/351] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:34.708801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d7bed-095e-4bd5-a2ba-f2656ae9bf00 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.723785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d7bed-095e-4bd5-a2ba-f2656ae9bf00 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.738243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8f23e-f800-4d0f-a0f2-c3931c31e02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.738906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8f23e-f800-4d0f-a0f2-c3931c31e02f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.739220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8f23e-f800-4d0f-a0f2-c3931c31e02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.739456 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8f23e-f800-4d0f-a0f2-c3931c31e02f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.755758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8f23e-f800-4d0f-a0f2-c3931c31e02f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.759144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8f23e-f800-4d0f-a0f2-c3931c31e02f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.774492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 174/352] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:34.776635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beb506-87af-4f95-a841-f4f976a85c2a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.798839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beb506-87af-4f95-a841-f4f976a85c2a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.806486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe950d-0dd7-44e4-af0f-f2f892a99fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.807362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe950d-0dd7-44e4-af0f-f2f892a99fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.807642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe950d-0dd7-44e4-af0f-f2f892a99fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.807916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe950d-0dd7-44e4-af0f-f2f892a99fa2 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.813166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe950d-0dd7-44e4-af0f-f2f892a99fa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.815256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe950d-0dd7-44e4-af0f-f2f892a99fa2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.817416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 179/353] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:34.823621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8f23e-f800-4d0f-a0f2-c3931c31e02f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.838910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8f23e-f800-4d0f-a0f2-c3931c31e02f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.843828 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e03988-7465-4e53-9fbf-21eda795b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.845015 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e03988-7465-4e53-9fbf-21eda795b33d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.845532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e03988-7465-4e53-9fbf-21eda795b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.846076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e03988-7465-4e53-9fbf-21eda795b33d admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.847544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e03988-7465-4e53-9fbf-21eda795b33d admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.848803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-12e03988-7465-4e53-9fbf-21eda795b33d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:34.848803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:28:34.848803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:28:34.850411 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e03988-7465-4e53-9fbf-21eda795b33d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.856970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 175/354] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:34.862970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe950d-0dd7-44e4-af0f-f2f892a99fa2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:34.881554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe950d-0dd7-44e4-af0f-f2f892a99fa2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:34.892844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a5078-5423-45d0-95d9-943651488864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:34.893515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a5078-5423-45d0-95d9-943651488864 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.893794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a5078-5423-45d0-95d9-943651488864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.894069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a5078-5423-45d0-95d9-943651488864 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.894920 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a5078-5423-45d0-95d9-943651488864 admin admin] RBAC: Adding query filter params (group.id=a6cc840b90534145a91d05a0f98a7b3f, role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:34.895230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a5078-5423-45d0-95d9-943651488864 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:34.897118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a5078-5423-45d0-95d9-943651488864 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:34.909236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 180/355] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:34 2022] GET /identity/v3/role_assignments?group.id=a6cc840b90534145a91d05a0f98a7b3f&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:34.930500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65e49-9cf9-4ac5-ac6c-602bd74be81f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.931472 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65e49-9cf9-4ac5-ac6c-602bd74be81f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.932095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65e49-9cf9-4ac5-ac6c-602bd74be81f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.938717 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 176/356] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:34.946436 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638db422-1706-4fbb-a8c3-72aed7db7b3e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:34.946751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638db422-1706-4fbb-a8c3-72aed7db7b3e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:34.946999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638db422-1706-4fbb-a8c3-72aed7db7b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:34.977293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-638db422-1706-4fbb-a8c3-72aed7db7b3e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:34.978517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-638db422-1706-4fbb-a8c3-72aed7db7b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:34.991284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 181/357] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:35.029995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65e49-9cf9-4ac5-ac6c-602bd74be81f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.049151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65e49-9cf9-4ac5-ac6c-602bd74be81f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.054916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d1e2-0c5d-4bf6-af7b-5bd1009d316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.056169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d1e2-0c5d-4bf6-af7b-5bd1009d316c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.056691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d1e2-0c5d-4bf6-af7b-5bd1009d316c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.057161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d1e2-0c5d-4bf6-af7b-5bd1009d316c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.071199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7d1e2-0c5d-4bf6-af7b-5bd1009d316c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:35.079663 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-73f7d1e2-0c5d-4bf6-af7b-5bd1009d316c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:35.081489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 177/358] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:35.087559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638db422-1706-4fbb-a8c3-72aed7db7b3e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.106924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638db422-1706-4fbb-a8c3-72aed7db7b3e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.114638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fabbe8-7207-4077-b450-d71298cf0c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.115333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fabbe8-7207-4077-b450-d71298cf0c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.115618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fabbe8-7207-4077-b450-d71298cf0c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.115894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fabbe8-7207-4077-b450-d71298cf0c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.117289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fabbe8-7207-4077-b450-d71298cf0c7d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:35.117595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fabbe8-7207-4077-b450-d71298cf0c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.119253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fabbe8-7207-4077-b450-d71298cf0c7d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.131602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 182/359] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:35.137540 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d1e2-0c5d-4bf6-af7b-5bd1009d316c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.152625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d1e2-0c5d-4bf6-af7b-5bd1009d316c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.157948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d26cc-bd34-4242-9555-67a0ac44883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.158969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d26cc-bd34-4242-9555-67a0ac44883b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.159516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d26cc-bd34-4242-9555-67a0ac44883b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.159996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d26cc-bd34-4242-9555-67a0ac44883b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.175057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d26cc-bd34-4242-9555-67a0ac44883b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.177299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d26cc-bd34-4242-9555-67a0ac44883b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.191212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 178/360] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:35.196982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fabbe8-7207-4077-b450-d71298cf0c7d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.216135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fabbe8-7207-4077-b450-d71298cf0c7d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.223046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421410d3-c719-4d01-a504-ca533b5c74bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.223905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421410d3-c719-4d01-a504-ca533b5c74bb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.224188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421410d3-c719-4d01-a504-ca533b5c74bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.224494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421410d3-c719-4d01-a504-ca533b5c74bb admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.229102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421410d3-c719-4d01-a504-ca533b5c74bb admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.231164 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421410d3-c719-4d01-a504-ca533b5c74bb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.232903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 183/361] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:35.238477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d26cc-bd34-4242-9555-67a0ac44883b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.248442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d26cc-bd34-4242-9555-67a0ac44883b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.257796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902a8e7-1f0f-4a96-bcca-66664e0a9d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.258667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a8e7-1f0f-4a96-bcca-66664e0a9d3f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.259003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a8e7-1f0f-4a96-bcca-66664e0a9d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.259280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902a8e7-1f0f-4a96-bcca-66664e0a9d3f admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.260636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902a8e7-1f0f-4a96-bcca-66664e0a9d3f admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.262646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902a8e7-1f0f-4a96-bcca-66664e0a9d3f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.264618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 179/362] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:35.270097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421410d3-c719-4d01-a504-ca533b5c74bb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.285677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421410d3-c719-4d01-a504-ca533b5c74bb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.296529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a820e55-3f91-4b41-82a3-6a424a9d2b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.297457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820e55-3f91-4b41-82a3-6a424a9d2b06 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.297936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820e55-3f91-4b41-82a3-6a424a9d2b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.298423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820e55-3f91-4b41-82a3-6a424a9d2b06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.299523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820e55-3f91-4b41-82a3-6a424a9d2b06 admin admin] RBAC: Adding query filter params (group.id=a6cc840b90534145a91d05a0f98a7b3f, role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:35.300068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820e55-3f91-4b41-82a3-6a424a9d2b06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.302168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a820e55-3f91-4b41-82a3-6a424a9d2b06 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.312461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 184/363] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/role_assignments?group.id=a6cc840b90534145a91d05a0f98a7b3f&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:35.424429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816123-1acb-4c08-a50c-9c11d4d08548 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.424789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816123-1acb-4c08-a50c-9c11d4d08548 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.424990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6816123-1acb-4c08-a50c-9c11d4d08548 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.426863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 180/364] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:35.433352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d19e8-b807-4183-bc3d-6542bc4f4528 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.433982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d19e8-b807-4183-bc3d-6542bc4f4528 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.434459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d19e8-b807-4183-bc3d-6542bc4f4528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.458100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c11d19e8-b807-4183-bc3d-6542bc4f4528 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:35.459677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c11d19e8-b807-4183-bc3d-6542bc4f4528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:35.469477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 185/365] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:35.504118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816123-1acb-4c08-a50c-9c11d4d08548 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.524261 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6816123-1acb-4c08-a50c-9c11d4d08548 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.532085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2524b-ee2d-4a74-b002-88a9bd93bdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.532914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2524b-ee2d-4a74-b002-88a9bd93bdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.533198 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2524b-ee2d-4a74-b002-88a9bd93bdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.533472 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2524b-ee2d-4a74-b002-88a9bd93bdd7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.548836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2524b-ee2d-4a74-b002-88a9bd93bdd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:35.555917 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-bbe2524b-ee2d-4a74-b002-88a9bd93bdd7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:28:35.557523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 181/366] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:35.562896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d19e8-b807-4183-bc3d-6542bc4f4528 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.577980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d19e8-b807-4183-bc3d-6542bc4f4528 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.584861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed3aa-95dd-4e37-9e6f-d1b68ecf427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.586296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed3aa-95dd-4e37-9e6f-d1b68ecf427f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.586726 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed3aa-95dd-4e37-9e6f-d1b68ecf427f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.587148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed3aa-95dd-4e37-9e6f-d1b68ecf427f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.588053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed3aa-95dd-4e37-9e6f-d1b68ecf427f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:35.588538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed3aa-95dd-4e37-9e6f-d1b68ecf427f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.590293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed3aa-95dd-4e37-9e6f-d1b68ecf427f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.604829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 186/367] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:35.609907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2524b-ee2d-4a74-b002-88a9bd93bdd7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.626875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2524b-ee2d-4a74-b002-88a9bd93bdd7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.636439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6183b-c788-436b-a84b-853bb043d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.637108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6183b-c788-436b-a84b-853bb043d2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.637447 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6183b-c788-436b-a84b-853bb043d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.637724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6183b-c788-436b-a84b-853bb043d2b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.649361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6183b-c788-436b-a84b-853bb043d2b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.651252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6183b-c788-436b-a84b-853bb043d2b5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.666168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 182/368] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:35.671631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed3aa-95dd-4e37-9e6f-d1b68ecf427f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.689999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed3aa-95dd-4e37-9e6f-d1b68ecf427f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.700393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0a649-acac-49ff-b003-d54a7a967dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.701795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0a649-acac-49ff-b003-d54a7a967dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.702284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0a649-acac-49ff-b003-d54a7a967dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.702754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0a649-acac-49ff-b003-d54a7a967dcc admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.705056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0a649-acac-49ff-b003-d54a7a967dcc admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b1044bcdc94a2da05a52b6795082d0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.707062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0a649-acac-49ff-b003-d54a7a967dcc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.709320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 187/369] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:35.715050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6183b-c788-436b-a84b-853bb043d2b5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.728725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6183b-c788-436b-a84b-853bb043d2b5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.734613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e5036-f2bf-40df-909a-4a5e06b33e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.735467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5036-f2bf-40df-909a-4a5e06b33e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.735748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5036-f2bf-40df-909a-4a5e06b33e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.736073 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e5036-f2bf-40df-909a-4a5e06b33e87 admin admin] PATH_INFO: `/v3/groups/017774548b05415cb95f037f50e5545d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.749204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e5036-f2bf-40df-909a-4a5e06b33e87 admin admin] RBAC: Authorizing `identity:get_group(group_id=017774548b05415cb95f037f50e5545d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.751194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e5036-f2bf-40df-909a-4a5e06b33e87 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.753283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 183/370] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/groups/017774548b05415cb95f037f50e5545d => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:35.759204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0a649-acac-49ff-b003-d54a7a967dcc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.769352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0a649-acac-49ff-b003-d54a7a967dcc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.780504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce04cd-4fb2-4bed-bdb5-e1f060ada9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.781899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce04cd-4fb2-4bed-bdb5-e1f060ada9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.782471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce04cd-4fb2-4bed-bdb5-e1f060ada9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.782939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce04cd-4fb2-4bed-bdb5-e1f060ada9c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.783984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce04cd-4fb2-4bed-bdb5-e1f060ada9c6 admin admin] RBAC: Adding query filter params (group.id=017774548b05415cb95f037f50e5545d, role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=f0b1044bcdc94a2da05a52b6795082d0) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:35.784517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce04cd-4fb2-4bed-bdb5-e1f060ada9c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.787181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccb92-7560-483b-91e2-dab1d8fce48a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.787596 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccb92-7560-483b-91e2-dab1d8fce48a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.787770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ccb92-7560-483b-91e2-dab1d8fce48a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.787861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce04cd-4fb2-4bed-bdb5-e1f060ada9c6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.790014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 184/371] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:35.794867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a72f1-0564-481c-a70d-90e549b0809a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.795370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a72f1-0564-481c-a70d-90e549b0809a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.795677 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a72f1-0564-481c-a70d-90e549b0809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.796061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 188/372] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/role_assignments?group.id=017774548b05415cb95f037f50e5545d&scope.project.id=f0b1044bcdc94a2da05a52b6795082d0&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:35.817775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6b5a72f1-0564-481c-a70d-90e549b0809a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:35.819073 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6b5a72f1-0564-481c-a70d-90e549b0809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:35.828552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 185/373] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:35.865092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce04cd-4fb2-4bed-bdb5-e1f060ada9c6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.875906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce04cd-4fb2-4bed-bdb5-e1f060ada9c6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.888041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080beec-c1f9-47c7-9326-8523f5afdfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.889170 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080beec-c1f9-47c7-9326-8523f5afdfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.889617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080beec-c1f9-47c7-9326-8523f5afdfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.890032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080beec-c1f9-47c7-9326-8523f5afdfd9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.914429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080beec-c1f9-47c7-9326-8523f5afdfd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:35.922099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6080beec-c1f9-47c7-9326-8523f5afdfd9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:35.923896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 189/374] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:35.929768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a72f1-0564-481c-a70d-90e549b0809a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.946193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a72f1-0564-481c-a70d-90e549b0809a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:35.956202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fe0e3-932a-47e6-96e6-a76da2fcf2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:35.956922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe0e3-932a-47e6-96e6-a76da2fcf2da admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:35.957207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe0e3-932a-47e6-96e6-a76da2fcf2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:35.957485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fe0e3-932a-47e6-96e6-a76da2fcf2da admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:35.958263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fe0e3-932a-47e6-96e6-a76da2fcf2da admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:35.958572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fe0e3-932a-47e6-96e6-a76da2fcf2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:35.960229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fe0e3-932a-47e6-96e6-a76da2fcf2da admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:35.973610 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 186/375] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:35.978975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080beec-c1f9-47c7-9326-8523f5afdfd9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:35.994774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080beec-c1f9-47c7-9326-8523f5afdfd9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:36.005163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd2ac7-5d46-4c03-9ab4-f7e3aad5c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:36.006219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd2ac7-5d46-4c03-9ab4-f7e3aad5c205 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:36.006700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd2ac7-5d46-4c03-9ab4-f7e3aad5c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:36.007766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd2ac7-5d46-4c03-9ab4-f7e3aad5c205 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:36.017104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd2ac7-5d46-4c03-9ab4-f7e3aad5c205 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:36.019228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd2ac7-5d46-4c03-9ab4-f7e3aad5c205 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:36.032272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 190/376] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:36.035259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fe0e3-932a-47e6-96e6-a76da2fcf2da admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:36.049696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fe0e3-932a-47e6-96e6-a76da2fcf2da admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:36.056508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b41dd6-9db1-41a3-8622-6cfbed4d634c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:36.057421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b41dd6-9db1-41a3-8622-6cfbed4d634c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:36.057808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b41dd6-9db1-41a3-8622-6cfbed4d634c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:36.058087 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b41dd6-9db1-41a3-8622-6cfbed4d634c admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:36.059359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b41dd6-9db1-41a3-8622-6cfbed4d634c admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:36.065454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b41dd6-9db1-41a3-8622-6cfbed4d634c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:36.067689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 187/377] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:36 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:36.073337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd2ac7-5d46-4c03-9ab4-f7e3aad5c205 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:36.082963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd2ac7-5d46-4c03-9ab4-f7e3aad5c205 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:36.095723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9ca77-2954-40dd-8053-29b9d18da95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:36.096921 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9ca77-2954-40dd-8053-29b9d18da95e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:36.097397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9ca77-2954-40dd-8053-29b9d18da95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:36.097865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9ca77-2954-40dd-8053-29b9d18da95e admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:36.105127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9ca77-2954-40dd-8053-29b9d18da95e admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:36.107248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9ca77-2954-40dd-8053-29b9d18da95e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:36.109488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 191/378] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:36 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:36.114866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b41dd6-9db1-41a3-8622-6cfbed4d634c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:36.129811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b41dd6-9db1-41a3-8622-6cfbed4d634c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:36.137178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ac31d-07d8-46d0-943d-51be3ebbfac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:36.138011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ac31d-07d8-46d0-943d-51be3ebbfac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:36.138294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ac31d-07d8-46d0-943d-51be3ebbfac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:36.138651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ac31d-07d8-46d0-943d-51be3ebbfac1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:36.140052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ac31d-07d8-46d0-943d-51be3ebbfac1 admin admin] RBAC: Adding query filter params (group.id=a6cc840b90534145a91d05a0f98a7b3f, role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:36.140761 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ac31d-07d8-46d0-943d-51be3ebbfac1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:36.142712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ac31d-07d8-46d0-943d-51be3ebbfac1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:36.154494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 188/379] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:36 2022] GET /identity/v3/role_assignments?group.id=a6cc840b90534145a91d05a0f98a7b3f&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:37.417650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c5f1-20e9-46e6-ba62-1eae8298440c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:37.418182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c5f1-20e9-46e6-ba62-1eae8298440c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:37.418182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257c5f1-20e9-46e6-ba62-1eae8298440c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:37.420328 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 192/380] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:37.425398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace3156-1d16-4f7d-bc89-721f4a33e784 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:37.425802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace3156-1d16-4f7d-bc89-721f4a33e784 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:37.426004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace3156-1d16-4f7d-bc89-721f4a33e784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:37.448774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bace3156-1d16-4f7d-bc89-721f4a33e784 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:37.449952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bace3156-1d16-4f7d-bc89-721f4a33e784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:37.462408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 189/381] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:37.496664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257c5f1-20e9-46e6-ba62-1eae8298440c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:37.514197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257c5f1-20e9-46e6-ba62-1eae8298440c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:37.518495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42a79-3fab-4f41-977f-39a6aee36812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:37.519295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42a79-3fab-4f41-977f-39a6aee36812 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:37.519569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42a79-3fab-4f41-977f-39a6aee36812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:37.519833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c42a79-3fab-4f41-977f-39a6aee36812 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:37.533490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c42a79-3fab-4f41-977f-39a6aee36812 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:37.540663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-d1c42a79-3fab-4f41-977f-39a6aee36812 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:37.542150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 193/382] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:37.547522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace3156-1d16-4f7d-bc89-721f4a33e784 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:37.557342 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace3156-1d16-4f7d-bc89-721f4a33e784 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:37.563886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9907f9-2d59-4789-9997-17c2eeb6b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:37.564577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9907f9-2d59-4789-9997-17c2eeb6b695 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:37.564855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9907f9-2d59-4789-9997-17c2eeb6b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:37.565122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9907f9-2d59-4789-9997-17c2eeb6b695 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:37.565880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9907f9-2d59-4789-9997-17c2eeb6b695 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:37.566176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9907f9-2d59-4789-9997-17c2eeb6b695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:37.567757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9907f9-2d59-4789-9997-17c2eeb6b695 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:37.581719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 190/383] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:37.586902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42a79-3fab-4f41-977f-39a6aee36812 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:37.596712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c42a79-3fab-4f41-977f-39a6aee36812 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:37.603916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d95ade-4a53-44cd-9b1d-1c06be5c898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:37.604790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d95ade-4a53-44cd-9b1d-1c06be5c898a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:37.605069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d95ade-4a53-44cd-9b1d-1c06be5c898a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:37.605338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d95ade-4a53-44cd-9b1d-1c06be5c898a admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:37.606529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d95ade-4a53-44cd-9b1d-1c06be5c898a admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:37.608466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d95ade-4a53-44cd-9b1d-1c06be5c898a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:37.610116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 194/384] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:37 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:37.615553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9907f9-2d59-4789-9997-17c2eeb6b695 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:37.626857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9907f9-2d59-4789-9997-17c2eeb6b695 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:37.636086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac0671-2480-4766-977b-0707f13b18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:37.636974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac0671-2480-4766-977b-0707f13b18a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:37.637245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac0671-2480-4766-977b-0707f13b18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:37.637521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac0671-2480-4766-977b-0707f13b18a7 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:37.638721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac0671-2480-4766-977b-0707f13b18a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:37.640795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac0671-2480-4766-977b-0707f13b18a7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:37.642679 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 191/385] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:37 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:37.648063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d95ade-4a53-44cd-9b1d-1c06be5c898a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:37.659627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d95ade-4a53-44cd-9b1d-1c06be5c898a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:37.664085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f58a5-b26a-4edf-81e5-6e7c61875163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:37.664980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f58a5-b26a-4edf-81e5-6e7c61875163 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:37.665313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f58a5-b26a-4edf-81e5-6e7c61875163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:37.665579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f58a5-b26a-4edf-81e5-6e7c61875163 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/groups/a6cc840b90534145a91d05a0f98a7b3f/roles/26c5ad3c42af492f9acc707c03567b73` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:37.667901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f58a5-b26a-4edf-81e5-6e7c61875163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c9bf6ae4fc41448605f4cdce111a09, group_id=a6cc840b90534145a91d05a0f98a7b3f, role_id=26c5ad3c42af492f9acc707c03567b73)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:37.670488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f58a5-b26a-4edf-81e5-6e7c61875163 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:37.703638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 195/386] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Feb 7 02:28:37 2022] PUT /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/groups/a6cc840b90534145a91d05a0f98a7b3f/roles/26c5ad3c42af492f9acc707c03567b73 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:38.194192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375eef9-964b-4ecf-ac11-7fc6502c34cc None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.195143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375eef9-964b-4ecf-ac11-7fc6502c34cc None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.195336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375eef9-964b-4ecf-ac11-7fc6502c34cc None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.197491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 192/387] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:38.203172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d979-b529-482f-845e-6ba25df9b326 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.203457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d979-b529-482f-845e-6ba25df9b326 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.203727 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d979-b529-482f-845e-6ba25df9b326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.224613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3625d979-b529-482f-845e-6ba25df9b326 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:38.225838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3625d979-b529-482f-845e-6ba25df9b326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:38.265084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67eefc9-8d5c-4355-a878-4af47ce792c2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.265407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67eefc9-8d5c-4355-a878-4af47ce792c2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.265646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67eefc9-8d5c-4355-a878-4af47ce792c2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.268152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 193/388] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:38.272814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5259-3bb5-4267-a0de-062b272022a0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.273261 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5259-3bb5-4267-a0de-062b272022a0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.273539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5259-3bb5-4267-a0de-062b272022a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.296279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a18d5259-3bb5-4267-a0de-062b272022a0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:38.297997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a18d5259-3bb5-4267-a0de-062b272022a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:38.316786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 196/389] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:38.342517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d979-b529-482f-845e-6ba25df9b326 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.352485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d979-b529-482f-845e-6ba25df9b326 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.359595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2427b22-84a1-4bb2-8f1e-3c3effcff76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.360420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2427b22-84a1-4bb2-8f1e-3c3effcff76a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.360700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2427b22-84a1-4bb2-8f1e-3c3effcff76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.360969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2427b22-84a1-4bb2-8f1e-3c3effcff76a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.374674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 194/390] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:38.378487 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2427b22-84a1-4bb2-8f1e-3c3effcff76a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:38.386171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a2427b22-84a1-4bb2-8f1e-3c3effcff76a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:38.387555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 197/391] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:38.393259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5259-3bb5-4267-a0de-062b272022a0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.402746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5259-3bb5-4267-a0de-062b272022a0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.407223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ae75-89a6-4fe7-93d6-5d04150acfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.407882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ae75-89a6-4fe7-93d6-5d04150acfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.408161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ae75-89a6-4fe7-93d6-5d04150acfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.408458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44ae75-89a6-4fe7-93d6-5d04150acfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.409224 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44ae75-89a6-4fe7-93d6-5d04150acfe1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:38.409526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44ae75-89a6-4fe7-93d6-5d04150acfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.411111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2427b22-84a1-4bb2-8f1e-3c3effcff76a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.417015 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44ae75-89a6-4fe7-93d6-5d04150acfe1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.423453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2427b22-84a1-4bb2-8f1e-3c3effcff76a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.433412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 195/392] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:38.434043 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f15ef-67f8-49a6-8d06-4a790de2d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.434780 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f15ef-67f8-49a6-8d06-4a790de2d613 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.435059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f15ef-67f8-49a6-8d06-4a790de2d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.435324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f15ef-67f8-49a6-8d06-4a790de2d613 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.438837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ae75-89a6-4fe7-93d6-5d04150acfe1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.453032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44ae75-89a6-4fe7-93d6-5d04150acfe1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.459236 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92735b6-f3c2-4894-a0c1-559ba2546ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.460126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92735b6-f3c2-4894-a0c1-559ba2546ceb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.460473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92735b6-f3c2-4894-a0c1-559ba2546ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.460735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92735b6-f3c2-4894-a0c1-559ba2546ceb admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.461931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92735b6-f3c2-4894-a0c1-559ba2546ceb admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.463837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92735b6-f3c2-4894-a0c1-559ba2546ceb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.465516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f15ef-67f8-49a6-8d06-4a790de2d613 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:38.468741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 196/393] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:38.471358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92735b6-f3c2-4894-a0c1-559ba2546ceb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.475780 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-dd6f15ef-67f8-49a6-8d06-4a790de2d613 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:38.484088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92735b6-f3c2-4894-a0c1-559ba2546ceb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.485343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 198/394] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:38.488879 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914ddd6-2eae-4dc0-91c8-59cd9d0ecb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.489728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ddd6-2eae-4dc0-91c8-59cd9d0ecb17 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.490007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ddd6-2eae-4dc0-91c8-59cd9d0ecb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.490280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ddd6-2eae-4dc0-91c8-59cd9d0ecb17 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.490581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f15ef-67f8-49a6-8d06-4a790de2d613 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.492036 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914ddd6-2eae-4dc0-91c8-59cd9d0ecb17 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.494104 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914ddd6-2eae-4dc0-91c8-59cd9d0ecb17 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.495785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 197/395] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:38.501496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa2713-13c6-4e29-b3f9-e81173c128f0 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.501779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa2713-13c6-4e29-b3f9-e81173c128f0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.502058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa2713-13c6-4e29-b3f9-e81173c128f0 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.504005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 198/396] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:38.504730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa2713-13c6-4e29-b3f9-e81173c128f0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.511664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f15ef-67f8-49a6-8d06-4a790de2d613 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.517138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c13e45-4f90-4c4f-8a51-f79a8e680fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.517413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa2713-13c6-4e29-b3f9-e81173c128f0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.517796 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13e45-4f90-4c4f-8a51-f79a8e680fad admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.518071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13e45-4f90-4c4f-8a51-f79a8e680fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.518346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c13e45-4f90-4c4f-8a51-f79a8e680fad admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.519869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13e45-4f90-4c4f-8a51-f79a8e680fad admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:38.519869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13e45-4f90-4c4f-8a51-f79a8e680fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.521025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c13e45-4f90-4c4f-8a51-f79a8e680fad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.523654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439d8ce-1e48-4aaa-95f6-f5da2f07372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.524731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d8ce-1e48-4aaa-95f6-f5da2f07372b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.525176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d8ce-1e48-4aaa-95f6-f5da2f07372b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.525593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439d8ce-1e48-4aaa-95f6-f5da2f07372b admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/groups/a6cc840b90534145a91d05a0f98a7b3f/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.527743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439d8ce-1e48-4aaa-95f6-f5da2f07372b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c9bf6ae4fc41448605f4cdce111a09, group_id=a6cc840b90534145a91d05a0f98a7b3f, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.530534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439d8ce-1e48-4aaa-95f6-f5da2f07372b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.535545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 199/397] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:38.537264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52762d75-9f82-4174-9489-4355b73bc165 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.537264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52762d75-9f82-4174-9489-4355b73bc165 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.537429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52762d75-9f82-4174-9489-4355b73bc165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.549640 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 199/398] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Feb 7 02:28:38 2022] PUT /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09/groups/a6cc840b90534145a91d05a0f98a7b3f/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:38.550458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439d8ce-1e48-4aaa-95f6-f5da2f07372b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.560000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-52762d75-9f82-4174-9489-4355b73bc165 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:38.561659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-52762d75-9f82-4174-9489-4355b73bc165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:38.630736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439d8ce-1e48-4aaa-95f6-f5da2f07372b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.639094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dda14b-1685-470d-a81d-758721055f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.640315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dda14b-1685-470d-a81d-758721055f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.640862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dda14b-1685-470d-a81d-758721055f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.641344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dda14b-1685-470d-a81d-758721055f40 admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.643483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dda14b-1685-470d-a81d-758721055f40 admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.644567 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 200/399] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:38.646195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dda14b-1685-470d-a81d-758721055f40 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.648241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 200/400] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:38.656550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52762d75-9f82-4174-9489-4355b73bc165 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.671257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52762d75-9f82-4174-9489-4355b73bc165 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.676040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2688-7cb4-48b0-95aa-eb32df1b2112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.677052 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2688-7cb4-48b0-95aa-eb32df1b2112 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.677331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2688-7cb4-48b0-95aa-eb32df1b2112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.677638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd2688-7cb4-48b0-95aa-eb32df1b2112 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.679559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd2688-7cb4-48b0-95aa-eb32df1b2112 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.681738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd2688-7cb4-48b0-95aa-eb32df1b2112 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.683878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 201/401] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:38.690002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dda14b-1685-470d-a81d-758721055f40 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.691368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2688-7cb4-48b0-95aa-eb32df1b2112 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.710415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dda14b-1685-470d-a81d-758721055f40 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.715792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd2688-7cb4-48b0-95aa-eb32df1b2112 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.717155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a11006-fb82-47fd-9b6e-86e293e3738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.718103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a11006-fb82-47fd-9b6e-86e293e3738b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.718379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a11006-fb82-47fd-9b6e-86e293e3738b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.718660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a11006-fb82-47fd-9b6e-86e293e3738b admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/groups/a6cc840b90534145a91d05a0f98a7b3f/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.721322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a11006-fb82-47fd-9b6e-86e293e3738b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1177859f1c41a78c7659b4df5f0dbf, group_id=a6cc840b90534145a91d05a0f98a7b3f, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.725034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a11006-fb82-47fd-9b6e-86e293e3738b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.731941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690a5e0-b9c3-46c0-9b74-bf7b0fb4e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.732899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690a5e0-b9c3-46c0-9b74-bf7b0fb4e8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.733178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690a5e0-b9c3-46c0-9b74-bf7b0fb4e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.733568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8690a5e0-b9c3-46c0-9b74-bf7b0fb4e8d1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.752410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 201/402] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Feb 7 02:28:38 2022] PUT /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/groups/a6cc840b90534145a91d05a0f98a7b3f/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:38.755345 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8690a5e0-b9c3-46c0-9b74-bf7b0fb4e8d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:38.767875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-8690a5e0-b9c3-46c0-9b74-bf7b0fb4e8d1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:28:38.769248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 202/403] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:38.776490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a11006-fb82-47fd-9b6e-86e293e3738b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.857463 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a11006-fb82-47fd-9b6e-86e293e3738b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.862914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd41766-0f6c-4eeb-97a6-e4548422ed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.863628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd41766-0f6c-4eeb-97a6-e4548422ed19 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.863918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd41766-0f6c-4eeb-97a6-e4548422ed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.864187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd41766-0f6c-4eeb-97a6-e4548422ed19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.865048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd41766-0f6c-4eeb-97a6-e4548422ed19 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:38.865353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd41766-0f6c-4eeb-97a6-e4548422ed19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.867678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd41766-0f6c-4eeb-97a6-e4548422ed19 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.878061 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 202/404] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:38.883741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690a5e0-b9c3-46c0-9b74-bf7b0fb4e8d1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.895250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8690a5e0-b9c3-46c0-9b74-bf7b0fb4e8d1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.900050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec58e82-5085-4963-bbf4-c2f5470f9c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.900995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec58e82-5085-4963-bbf4-c2f5470f9c51 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.901329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec58e82-5085-4963-bbf4-c2f5470f9c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.901631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec58e82-5085-4963-bbf4-c2f5470f9c51 admin admin] PATH_INFO: `/v3/groups/017774548b05415cb95f037f50e5545d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.902931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec58e82-5085-4963-bbf4-c2f5470f9c51 admin admin] RBAC: Authorizing `identity:get_group(group_id=017774548b05415cb95f037f50e5545d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.904975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec58e82-5085-4963-bbf4-c2f5470f9c51 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.907093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 203/405] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/groups/017774548b05415cb95f037f50e5545d => generated 229 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:38.912589 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd41766-0f6c-4eeb-97a6-e4548422ed19 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.925666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd41766-0f6c-4eeb-97a6-e4548422ed19 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.932693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d860c-9b75-4810-bdfa-4f9567ddd8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.933627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d860c-9b75-4810-bdfa-4f9567ddd8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.933958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d860c-9b75-4810-bdfa-4f9567ddd8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.934235 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d860c-9b75-4810-bdfa-4f9567ddd8b8 admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.935559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d860c-9b75-4810-bdfa-4f9567ddd8b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b1044bcdc94a2da05a52b6795082d0)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.937509 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d860c-9b75-4810-bdfa-4f9567ddd8b8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.939405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 203/406] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:38 2022] GET /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:38.945275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec58e82-5085-4963-bbf4-c2f5470f9c51 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:38.956413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec58e82-5085-4963-bbf4-c2f5470f9c51 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:38.962068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4ece-0ad7-45ab-9b93-76821d39e11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:38.962952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4ece-0ad7-45ab-9b93-76821d39e11f admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:38.963220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4ece-0ad7-45ab-9b93-76821d39e11f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:38.963494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4ece-0ad7-45ab-9b93-76821d39e11f admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0/groups/017774548b05415cb95f037f50e5545d/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:38.965676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f4ece-0ad7-45ab-9b93-76821d39e11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b1044bcdc94a2da05a52b6795082d0, group_id=017774548b05415cb95f037f50e5545d, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:38.968868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f4ece-0ad7-45ab-9b93-76821d39e11f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:38.993247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 204/407] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Feb 7 02:28:38 2022] PUT /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0/groups/017774548b05415cb95f037f50e5545d/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:39.318278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b623c-3ddb-4246-8106-fb833a32c827 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:39.318278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b623c-3ddb-4246-8106-fb833a32c827 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:39.318278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b623c-3ddb-4246-8106-fb833a32c827 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:39.319144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 204/408] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:39.325648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7add62c-39ea-4f47-9f76-ae241b567caa None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:39.326434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7add62c-39ea-4f47-9f76-ae241b567caa None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:39.326911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7add62c-39ea-4f47-9f76-ae241b567caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:39.345181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e7add62c-39ea-4f47-9f76-ae241b567caa None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:39.346683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e7add62c-39ea-4f47-9f76-ae241b567caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:39.415053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 205/409] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:39.439708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b623c-3ddb-4246-8106-fb833a32c827 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:39.456724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b623c-3ddb-4246-8106-fb833a32c827 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:39.461596 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536a02-f655-494e-8175-3613104447b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:39.462666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536a02-f655-494e-8175-3613104447b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:39.463144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536a02-f655-494e-8175-3613104447b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:39.463623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02536a02-f655-494e-8175-3613104447b5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:39.480516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02536a02-f655-494e-8175-3613104447b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:39.488398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-02536a02-f655-494e-8175-3613104447b5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:39.489814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 205/410] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:39.496397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7add62c-39ea-4f47-9f76-ae241b567caa None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:39.506260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7add62c-39ea-4f47-9f76-ae241b567caa None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:39.515001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3f6c-bec0-46cb-bf8e-b94766a2d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:39.515977 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3f6c-bec0-46cb-bf8e-b94766a2d347 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:39.516516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3f6c-bec0-46cb-bf8e-b94766a2d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:39.517002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3f6c-bec0-46cb-bf8e-b94766a2d347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:39.518045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd3f6c-bec0-46cb-bf8e-b94766a2d347 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:39.518547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd3f6c-bec0-46cb-bf8e-b94766a2d347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:39.520635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd3f6c-bec0-46cb-bf8e-b94766a2d347 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:39.530556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 206/411] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:39.536739 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536a02-f655-494e-8175-3613104447b5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:39.550982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02536a02-f655-494e-8175-3613104447b5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:39.556451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee773440-b693-4eb6-ad61-3814abdf5612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:39.557618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773440-b693-4eb6-ad61-3814abdf5612 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:39.558126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773440-b693-4eb6-ad61-3814abdf5612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:39.558590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773440-b693-4eb6-ad61-3814abdf5612 admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:39.560064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee773440-b693-4eb6-ad61-3814abdf5612 admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:39.562233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee773440-b693-4eb6-ad61-3814abdf5612 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:39.568512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 206/412] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:39 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:39.570262 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3f6c-bec0-46cb-bf8e-b94766a2d347 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:39.580978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3f6c-bec0-46cb-bf8e-b94766a2d347 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:39.585761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e743b-e946-4937-840a-395fba583186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:39.586928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e743b-e946-4937-840a-395fba583186 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:39.587423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e743b-e946-4937-840a-395fba583186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:39.587899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e743b-e946-4937-840a-395fba583186 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:39.589395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e743b-e946-4937-840a-395fba583186 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:39.591812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e743b-e946-4937-840a-395fba583186 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:39.596197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 207/413] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:39 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:39.599931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee773440-b693-4eb6-ad61-3814abdf5612 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:39.611099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee773440-b693-4eb6-ad61-3814abdf5612 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:39.615897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de67983-e7c4-475a-8b95-59701ebbd5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:39.617664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de67983-e7c4-475a-8b95-59701ebbd5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:39.618208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de67983-e7c4-475a-8b95-59701ebbd5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:39.618765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de67983-e7c4-475a-8b95-59701ebbd5b3 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/groups/a6cc840b90534145a91d05a0f98a7b3f/roles/26c5ad3c42af492f9acc707c03567b73` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:39.621592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de67983-e7c4-475a-8b95-59701ebbd5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1177859f1c41a78c7659b4df5f0dbf, group_id=a6cc840b90534145a91d05a0f98a7b3f, role_id=26c5ad3c42af492f9acc707c03567b73)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:39.624573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de67983-e7c4-475a-8b95-59701ebbd5b3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:39.644438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 207/414] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Feb 7 02:28:39 2022] PUT /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf/groups/a6cc840b90534145a91d05a0f98a7b3f/roles/26c5ad3c42af492f9acc707c03567b73 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:40.831758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993666f1-a453-4d55-9025-670e09762a92 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:40.832807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993666f1-a453-4d55-9025-670e09762a92 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:40.833289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993666f1-a453-4d55-9025-670e09762a92 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:40.835565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 208/415] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:40.840767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a97fc-3a46-4637-87d1-e2faf862683e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:40.841557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a97fc-3a46-4637-87d1-e2faf862683e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:40.842030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a97fc-3a46-4637-87d1-e2faf862683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:40.861235 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-588a97fc-3a46-4637-87d1-e2faf862683e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:40.862745 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-588a97fc-3a46-4637-87d1-e2faf862683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:40.925833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 208/416] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:40.964472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993666f1-a453-4d55-9025-670e09762a92 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:40.982258 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993666f1-a453-4d55-9025-670e09762a92 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:40.986990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c4bd-d1b9-4b0c-9f00-4aa4bb7787f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:40.988005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c4bd-d1b9-4b0c-9f00-4aa4bb7787f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:40.988533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c4bd-d1b9-4b0c-9f00-4aa4bb7787f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:40.989003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9755c4bd-d1b9-4b0c-9f00-4aa4bb7787f9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.000230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9755c4bd-d1b9-4b0c-9f00-4aa4bb7787f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:41.007652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-9755c4bd-d1b9-4b0c-9f00-4aa4bb7787f9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:41.009346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 209/417] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:41.014633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a97fc-3a46-4637-87d1-e2faf862683e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:41.024217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a97fc-3a46-4637-87d1-e2faf862683e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:41.032009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259581c-6710-4122-a0f6-8db9a1d31d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:41.037071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259581c-6710-4122-a0f6-8db9a1d31d10 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.037562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259581c-6710-4122-a0f6-8db9a1d31d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.038690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259581c-6710-4122-a0f6-8db9a1d31d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.039509 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259581c-6710-4122-a0f6-8db9a1d31d10 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:41.039988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259581c-6710-4122-a0f6-8db9a1d31d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:41.041788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259581c-6710-4122-a0f6-8db9a1d31d10 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:41.051021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 209/418] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:41.057116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c4bd-d1b9-4b0c-9f00-4aa4bb7787f9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:41.068314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9755c4bd-d1b9-4b0c-9f00-4aa4bb7787f9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:41.076185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a768b-bf72-497e-a0eb-46028137ebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:41.077073 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a768b-bf72-497e-a0eb-46028137ebba admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.077529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a768b-bf72-497e-a0eb-46028137ebba admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.078002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a768b-bf72-497e-a0eb-46028137ebba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.089783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a768b-bf72-497e-a0eb-46028137ebba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:41.091790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a768b-bf72-497e-a0eb-46028137ebba admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:41.106879 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 210/419] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:41.112162 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259581c-6710-4122-a0f6-8db9a1d31d10 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:41.123801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259581c-6710-4122-a0f6-8db9a1d31d10 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:41.132178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ea4b2-c90f-4a7f-91dc-27b00e3cebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:41.133407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ea4b2-c90f-4a7f-91dc-27b00e3cebe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.133863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ea4b2-c90f-4a7f-91dc-27b00e3cebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.134345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ea4b2-c90f-4a7f-91dc-27b00e3cebe2 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.135803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ea4b2-c90f-4a7f-91dc-27b00e3cebe2 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:41.138111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ea4b2-c90f-4a7f-91dc-27b00e3cebe2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:41.140313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 210/420] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:41 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:41.145491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a768b-bf72-497e-a0eb-46028137ebba admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:41.154956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a768b-bf72-497e-a0eb-46028137ebba admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:41.163918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdfc7f-2f9a-4edb-9b04-71985ca4b329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:41.165048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdfc7f-2f9a-4edb-9b04-71985ca4b329 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.165514 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdfc7f-2f9a-4edb-9b04-71985ca4b329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.165955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdfc7f-2f9a-4edb-9b04-71985ca4b329 admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.167408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdfc7f-2f9a-4edb-9b04-71985ca4b329 admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:41.169513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdfc7f-2f9a-4edb-9b04-71985ca4b329 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:41.171349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 211/421] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:41 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:41.177218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ea4b2-c90f-4a7f-91dc-27b00e3cebe2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:41.188292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ea4b2-c90f-4a7f-91dc-27b00e3cebe2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:41.198025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378d1f5-82ad-4c25-a156-8de9e62b7723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:41.199024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d1f5-82ad-4c25-a156-8de9e62b7723 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.199651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d1f5-82ad-4c25-a156-8de9e62b7723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.200178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d1f5-82ad-4c25-a156-8de9e62b7723 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.201542 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378d1f5-82ad-4c25-a156-8de9e62b7723 admin admin] RBAC: Adding query filter params (group.id=a6cc840b90534145a91d05a0f98a7b3f, role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:41.202108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378d1f5-82ad-4c25-a156-8de9e62b7723 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:41.204192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378d1f5-82ad-4c25-a156-8de9e62b7723 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:41.215742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 211/422] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:41 2022] GET /identity/v3/role_assignments?group.id=a6cc840b90534145a91d05a0f98a7b3f&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:41.879262 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a09f4-3260-44e4-ac2a-67ca50dc2489 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.879756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a09f4-3260-44e4-ac2a-67ca50dc2489 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.879857 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a09f4-3260-44e4-ac2a-67ca50dc2489 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.881953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 212/423] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:41.887354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8d651-b33c-48d9-ae54-2f61f6e21610 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.888192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8d651-b33c-48d9-ae54-2f61f6e21610 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.888686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8d651-b33c-48d9-ae54-2f61f6e21610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.909149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-57d8d651-b33c-48d9-ae54-2f61f6e21610 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:41.910680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-57d8d651-b33c-48d9-ae54-2f61f6e21610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:41.922802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 212/424] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:41.937345 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0997a9-c0e1-4db3-af61-bc67168d4278 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.937603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0997a9-c0e1-4db3-af61-bc67168d4278 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.937818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0997a9-c0e1-4db3-af61-bc67168d4278 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.939834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 213/425] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:41.945123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e57b-b927-42dc-aac0-ba04327b4c6a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.945671 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e57b-b927-42dc-aac0-ba04327b4c6a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.946152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e57b-b927-42dc-aac0-ba04327b4c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.951983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0997a9-c0e1-4db3-af61-bc67168d4278 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:41.970581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0997a9-c0e1-4db3-af61-bc67168d4278 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:41.970880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3c48e57b-b927-42dc-aac0-ba04327b4c6a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:41.973938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3c48e57b-b927-42dc-aac0-ba04327b4c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:41.981386 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd368e6-e034-44c3-b570-edde5d3c74d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:41.984207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd368e6-e034-44c3-b570-edde5d3c74d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:41.984534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd368e6-e034-44c3-b570-edde5d3c74d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:41.984807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd368e6-e034-44c3-b570-edde5d3c74d3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:41.986707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 213/426] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:41.998962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd368e6-e034-44c3-b570-edde5d3c74d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:42.007404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7796d4d-dc75-43c7-9528-27e57d0a031f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.007632 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0bd368e6-e034-44c3-b570-edde5d3c74d3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:42.008155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7796d4d-dc75-43c7-9528-27e57d0a031f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.008652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7796d4d-dc75-43c7-9528-27e57d0a031f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.009152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 214/427] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:42.010795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 214/428] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:42.014473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd368e6-e034-44c3-b570-edde5d3c74d3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.016798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7796d4d-dc75-43c7-9528-27e57d0a031f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.024991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd368e6-e034-44c3-b570-edde5d3c74d3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.029654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda7982-f728-426a-84f1-10e2824ed8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.030336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7982-f728-426a-84f1-10e2824ed8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.030612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7982-f728-426a-84f1-10e2824ed8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.030882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda7982-f728-426a-84f1-10e2824ed8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.031814 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda7982-f728-426a-84f1-10e2824ed8c2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:42.031956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda7982-f728-426a-84f1-10e2824ed8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.033272 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7796d4d-dc75-43c7-9528-27e57d0a031f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.033715 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda7982-f728-426a-84f1-10e2824ed8c2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.038884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315a4eb-cea0-48b3-b683-aa625d63827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.039699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315a4eb-cea0-48b3-b683-aa625d63827c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.039983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315a4eb-cea0-48b3-b683-aa625d63827c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.040259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315a4eb-cea0-48b3-b683-aa625d63827c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.047882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 215/429] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.049584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565001a8-39ac-40d0-a4e0-e06f33a8783e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.050043 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565001a8-39ac-40d0-a4e0-e06f33a8783e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.050490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565001a8-39ac-40d0-a4e0-e06f33a8783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.065046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315a4eb-cea0-48b3-b683-aa625d63827c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:42.072542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-565001a8-39ac-40d0-a4e0-e06f33a8783e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:42.073659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-5315a4eb-cea0-48b3-b683-aa625d63827c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:28:42.074149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-565001a8-39ac-40d0-a4e0-e06f33a8783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:42.075364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 215/430] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:42.076454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315a4eb-cea0-48b3-b683-aa625d63827c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.083964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 216/431] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:42.085031 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565001a8-39ac-40d0-a4e0-e06f33a8783e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.090749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315a4eb-cea0-48b3-b683-aa625d63827c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.094278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565001a8-39ac-40d0-a4e0-e06f33a8783e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.098786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a4478-64fb-4c2d-af09-02e7bf5f8667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.100037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a4478-64fb-4c2d-af09-02e7bf5f8667 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.100746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e790b3-e6f6-47c1-ac34-f30834657ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.101536 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e790b3-e6f6-47c1-ac34-f30834657ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.101954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a4478-64fb-4c2d-af09-02e7bf5f8667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.102386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a4478-64fb-4c2d-af09-02e7bf5f8667 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.102805 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e790b3-e6f6-47c1-ac34-f30834657ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.103773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e790b3-e6f6-47c1-ac34-f30834657ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.104678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e790b3-e6f6-47c1-ac34-f30834657ae7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:42.105425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e790b3-e6f6-47c1-ac34-f30834657ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.109984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e790b3-e6f6-47c1-ac34-f30834657ae7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.117465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a4478-64fb-4c2d-af09-02e7bf5f8667 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.119462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a4478-64fb-4c2d-af09-02e7bf5f8667 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.121320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 217/432] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.122117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e790b3-e6f6-47c1-ac34-f30834657ae7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.130050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 216/433] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:42.135092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e790b3-e6f6-47c1-ac34-f30834657ae7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.136158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a4478-64fb-4c2d-af09-02e7bf5f8667 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.137920 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c133f-65cf-46ae-bd31-d488f9c0089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.138709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c133f-65cf-46ae-bd31-d488f9c0089d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.138981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c133f-65cf-46ae-bd31-d488f9c0089d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.139245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c133f-65cf-46ae-bd31-d488f9c0089d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.148115 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a4478-64fb-4c2d-af09-02e7bf5f8667 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.154173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6572796-21b9-4c80-bf41-c586fc8ce87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.155117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6572796-21b9-4c80-bf41-c586fc8ce87e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.155401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6572796-21b9-4c80-bf41-c586fc8ce87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.155675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6572796-21b9-4c80-bf41-c586fc8ce87e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.157398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c133f-65cf-46ae-bd31-d488f9c0089d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:42.164888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6572796-21b9-4c80-bf41-c586fc8ce87e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.165994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-125c133f-65cf-46ae-bd31-d488f9c0089d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 07 02:28:42.166769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6572796-21b9-4c80-bf41-c586fc8ce87e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.167515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 218/434] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:42.168421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c133f-65cf-46ae-bd31-d488f9c0089d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.179559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c133f-65cf-46ae-bd31-d488f9c0089d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.182956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 217/435] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:42.183701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6572796-21b9-4c80-bf41-c586fc8ce87e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.183951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456f19d-1326-4c1c-8fb3-7b1503a77b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.184860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456f19d-1326-4c1c-8fb3-7b1503a77b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.185138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456f19d-1326-4c1c-8fb3-7b1503a77b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.185409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456f19d-1326-4c1c-8fb3-7b1503a77b86 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.186609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456f19d-1326-4c1c-8fb3-7b1503a77b86 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.188724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456f19d-1326-4c1c-8fb3-7b1503a77b86 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.190817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 219/436] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.191567 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456f19d-1326-4c1c-8fb3-7b1503a77b86 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.195348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6572796-21b9-4c80-bf41-c586fc8ce87e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.200167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1e2ee-0a7b-4e95-874f-18a1ecf3d604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.201214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e2ee-0a7b-4e95-874f-18a1ecf3d604 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.201495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e2ee-0a7b-4e95-874f-18a1ecf3d604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.201802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1e2ee-0a7b-4e95-874f-18a1ecf3d604 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.202058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456f19d-1326-4c1c-8fb3-7b1503a77b86 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.202551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1e2ee-0a7b-4e95-874f-18a1ecf3d604 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:42.202853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1e2ee-0a7b-4e95-874f-18a1ecf3d604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.204606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1e2ee-0a7b-4e95-874f-18a1ecf3d604 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.210058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb3ce8-37fe-4609-9a18-ab9bcc1732ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.211150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb3ce8-37fe-4609-9a18-ab9bcc1732ca admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.211606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb3ce8-37fe-4609-9a18-ab9bcc1732ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.211887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb3ce8-37fe-4609-9a18-ab9bcc1732ca admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.213099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb3ce8-37fe-4609-9a18-ab9bcc1732ca admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b1044bcdc94a2da05a52b6795082d0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.214883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb3ce8-37fe-4609-9a18-ab9bcc1732ca admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.216212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 218/437] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.216453 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1e2ee-0a7b-4e95-874f-18a1ecf3d604 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.216911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 220/438] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.221991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb3ce8-37fe-4609-9a18-ab9bcc1732ca admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.230839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1e2ee-0a7b-4e95-874f-18a1ecf3d604 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.231790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb3ce8-37fe-4609-9a18-ab9bcc1732ca admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.235181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc32f-c859-4c9a-8c4a-0c7ee82c3aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.236020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc32f-c859-4c9a-8c4a-0c7ee82c3aea admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.236305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc32f-c859-4c9a-8c4a-0c7ee82c3aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.236604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc32f-c859-4c9a-8c4a-0c7ee82c3aea admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.237008 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcaf02-83c0-41e5-af82-af29f525976a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.237640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcaf02-83c0-41e5-af82-af29f525976a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.238013 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcaf02-83c0-41e5-af82-af29f525976a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.238189 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bcaf02-83c0-41e5-af82-af29f525976a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.238591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dc32f-c859-4c9a-8c4a-0c7ee82c3aea admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.241805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dc32f-c859-4c9a-8c4a-0c7ee82c3aea admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.243416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 219/439] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.244153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc32f-c859-4c9a-8c4a-0c7ee82c3aea admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.249631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcaf02-83c0-41e5-af82-af29f525976a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.251586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bcaf02-83c0-41e5-af82-af29f525976a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.253973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc32f-c859-4c9a-8c4a-0c7ee82c3aea admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.259413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e7b4-f309-45fa-a86d-ba836015eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.260242 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e7b4-f309-45fa-a86d-ba836015eb38 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.260546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e7b4-f309-45fa-a86d-ba836015eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.260818 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562e7b4-f309-45fa-a86d-ba836015eb38 admin admin] PATH_INFO: `/v3/groups/017774548b05415cb95f037f50e5545d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.262005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e7b4-f309-45fa-a86d-ba836015eb38 admin admin] RBAC: Authorizing `identity:get_group(group_id=017774548b05415cb95f037f50e5545d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.263101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 221/440] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:42.263858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562e7b4-f309-45fa-a86d-ba836015eb38 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.264042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcaf02-83c0-41e5-af82-af29f525976a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.265665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 220/441] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/groups/017774548b05415cb95f037f50e5545d => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.270936 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e7b4-f309-45fa-a86d-ba836015eb38 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.277804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bcaf02-83c0-41e5-af82-af29f525976a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.280290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562e7b4-f309-45fa-a86d-ba836015eb38 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.282371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c7242-6571-4e7c-98d9-dbf32ea1d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.283010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7242-6571-4e7c-98d9-dbf32ea1d205 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.283286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7242-6571-4e7c-98d9-dbf32ea1d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.283553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c7242-6571-4e7c-98d9-dbf32ea1d205 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.285975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c7242-6571-4e7c-98d9-dbf32ea1d205 admin admin] RBAC: Adding query filter params (group.id=a6cc840b90534145a91d05a0f98a7b3f, role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=26c9bf6ae4fc41448605f4cdce111a09) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:42.285975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c7242-6571-4e7c-98d9-dbf32ea1d205 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.286538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c7242-6571-4e7c-98d9-dbf32ea1d205 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.287169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30da6d-9697-48e3-a897-4cff077f3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.287841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30da6d-9697-48e3-a897-4cff077f3f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.287841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30da6d-9697-48e3-a897-4cff077f3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.288054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30da6d-9697-48e3-a897-4cff077f3f5a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.288864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30da6d-9697-48e3-a897-4cff077f3f5a admin admin] RBAC: Adding query filter params (group.id=017774548b05415cb95f037f50e5545d, role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=f0b1044bcdc94a2da05a52b6795082d0) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:42.289173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30da6d-9697-48e3-a897-4cff077f3f5a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.291704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30da6d-9697-48e3-a897-4cff077f3f5a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.294917 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 222/442] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/role_assignments?group.id=a6cc840b90534145a91d05a0f98a7b3f&scope.project.id=26c9bf6ae4fc41448605f4cdce111a09&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.295847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c7242-6571-4e7c-98d9-dbf32ea1d205 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.303060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 221/443] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/role_assignments?group.id=017774548b05415cb95f037f50e5545d&scope.project.id=f0b1044bcdc94a2da05a52b6795082d0&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:42.306384 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c7242-6571-4e7c-98d9-dbf32ea1d205 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.311101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39bf37-6dc7-4c0e-a189-ff19c276ec69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.311975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39bf37-6dc7-4c0e-a189-ff19c276ec69 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.312256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39bf37-6dc7-4c0e-a189-ff19c276ec69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.312580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39bf37-6dc7-4c0e-a189-ff19c276ec69 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.313829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39bf37-6dc7-4c0e-a189-ff19c276ec69 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.315901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39bf37-6dc7-4c0e-a189-ff19c276ec69 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.318215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 223/444] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.318397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012663-8a2b-49f1-8202-94f54039515e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.318494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012663-8a2b-49f1-8202-94f54039515e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.318722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012663-8a2b-49f1-8202-94f54039515e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.321662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 222/445] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:42.324788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39bf37-6dc7-4c0e-a189-ff19c276ec69 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.327728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f12a-ae16-4a2e-b0d1-476090b1d4b1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.328074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f12a-ae16-4a2e-b0d1-476090b1d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.328283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f12a-ae16-4a2e-b0d1-476090b1d4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.338238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39bf37-6dc7-4c0e-a189-ff19c276ec69 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.347522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ceb73e-e097-4d30-9613-703092b4e312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.348443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ceb73e-e097-4d30-9613-703092b4e312 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.348725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ceb73e-e097-4d30-9613-703092b4e312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.349000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ceb73e-e097-4d30-9613-703092b4e312 admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.349776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8617f12a-ae16-4a2e-b0d1-476090b1d4b1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:42.350286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ceb73e-e097-4d30-9613-703092b4e312 admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.351642 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8617f12a-ae16-4a2e-b0d1-476090b1d4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:42.352869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ceb73e-e097-4d30-9613-703092b4e312 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.355021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 224/446] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.360397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 223/447] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:42.361149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ceb73e-e097-4d30-9613-703092b4e312 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.379251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ceb73e-e097-4d30-9613-703092b4e312 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.384700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c398743-87e3-4511-bda7-42f822ea02c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.385844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c398743-87e3-4511-bda7-42f822ea02c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.386326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c398743-87e3-4511-bda7-42f822ea02c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.386796 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c398743-87e3-4511-bda7-42f822ea02c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.387245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617f12a-ae16-4a2e-b0d1-476090b1d4b1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.388222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c398743-87e3-4511-bda7-42f822ea02c0 admin admin] RBAC: Adding query filter params (group.id=a6cc840b90534145a91d05a0f98a7b3f, role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:42.388796 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c398743-87e3-4511-bda7-42f822ea02c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.390910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c398743-87e3-4511-bda7-42f822ea02c0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.397475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617f12a-ae16-4a2e-b0d1-476090b1d4b1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.398410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 225/448] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/role_assignments?group.id=a6cc840b90534145a91d05a0f98a7b3f&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 611 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.408297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13916a7a-7b93-4c9e-9d0c-01b1e2950c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.409243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13916a7a-7b93-4c9e-9d0c-01b1e2950c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.409574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13916a7a-7b93-4c9e-9d0c-01b1e2950c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.409894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13916a7a-7b93-4c9e-9d0c-01b1e2950c85 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.425086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13916a7a-7b93-4c9e-9d0c-01b1e2950c85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:42.433435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-13916a7a-7b93-4c9e-9d0c-01b1e2950c85 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:42.434748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 224/449] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:42.441111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c398743-87e3-4511-bda7-42f822ea02c0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.452510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c398743-87e3-4511-bda7-42f822ea02c0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.457820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a83706-cfcf-4cf3-9663-fb22d390258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.458507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83706-cfcf-4cf3-9663-fb22d390258a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.458783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83706-cfcf-4cf3-9663-fb22d390258a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.459055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a83706-cfcf-4cf3-9663-fb22d390258a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.459861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a83706-cfcf-4cf3-9663-fb22d390258a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:42.460174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a83706-cfcf-4cf3-9663-fb22d390258a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.461896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a83706-cfcf-4cf3-9663-fb22d390258a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.471917 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 226/450] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.478343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13916a7a-7b93-4c9e-9d0c-01b1e2950c85 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.489185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13916a7a-7b93-4c9e-9d0c-01b1e2950c85 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.494615 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f823-9892-4a78-9a4e-38a032484deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.495296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f823-9892-4a78-9a4e-38a032484deb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.495576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f823-9892-4a78-9a4e-38a032484deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.495853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f823-9892-4a78-9a4e-38a032484deb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.505666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f823-9892-4a78-9a4e-38a032484deb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.507867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f823-9892-4a78-9a4e-38a032484deb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.518319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 225/451] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:42.525336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a83706-cfcf-4cf3-9663-fb22d390258a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.535977 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a83706-cfcf-4cf3-9663-fb22d390258a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.541186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749914d-1d69-4fa1-b36b-e3dfe7f46fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.542074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749914d-1d69-4fa1-b36b-e3dfe7f46fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.542344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749914d-1d69-4fa1-b36b-e3dfe7f46fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.542611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749914d-1d69-4fa1-b36b-e3dfe7f46fc4 admin admin] PATH_INFO: `/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.543866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749914d-1d69-4fa1-b36b-e3dfe7f46fc4 admin admin] RBAC: Authorizing `identity:get_project(project_id=ae1177859f1c41a78c7659b4df5f0dbf)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.545955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749914d-1d69-4fa1-b36b-e3dfe7f46fc4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.547721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 227/452] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/projects/ae1177859f1c41a78c7659b4df5f0dbf => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.553440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f823-9892-4a78-9a4e-38a032484deb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.565402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f823-9892-4a78-9a4e-38a032484deb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.570163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fffb0-140e-444a-8251-b9a540da248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.571040 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fffb0-140e-444a-8251-b9a540da248f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.571344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fffb0-140e-444a-8251-b9a540da248f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.571582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fffb0-140e-444a-8251-b9a540da248f admin admin] PATH_INFO: `/v3/groups/a6cc840b90534145a91d05a0f98a7b3f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.572870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fffb0-140e-444a-8251-b9a540da248f admin admin] RBAC: Authorizing `identity:get_group(group_id=a6cc840b90534145a91d05a0f98a7b3f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.574782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fffb0-140e-444a-8251-b9a540da248f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.576906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 226/453] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/groups/a6cc840b90534145a91d05a0f98a7b3f => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:42.582760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749914d-1d69-4fa1-b36b-e3dfe7f46fc4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:42.597957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749914d-1d69-4fa1-b36b-e3dfe7f46fc4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:42.603587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44fba2-883b-4e60-8565-82dbd88672ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:42.604243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44fba2-883b-4e60-8565-82dbd88672ce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:42.604555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44fba2-883b-4e60-8565-82dbd88672ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:42.604818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44fba2-883b-4e60-8565-82dbd88672ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:42.605657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44fba2-883b-4e60-8565-82dbd88672ce admin admin] RBAC: Adding query filter params (group.id=a6cc840b90534145a91d05a0f98a7b3f, role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:42.605961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44fba2-883b-4e60-8565-82dbd88672ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:42.607820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44fba2-883b-4e60-8565-82dbd88672ce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:42.615379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 228/454] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Feb 7 02:28:42 2022] GET /identity/v3/role_assignments?group.id=a6cc840b90534145a91d05a0f98a7b3f&scope.project.id=ae1177859f1c41a78c7659b4df5f0dbf&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:45.925281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ab1b9-aa9d-4773-a2d6-e27d2e9f9f82 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:45.926339 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ab1b9-aa9d-4773-a2d6-e27d2e9f9f82 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:45.926883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ab1b9-aa9d-4773-a2d6-e27d2e9f9f82 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:45.929889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 227/455] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:45.935539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b652-b448-4ace-8ab5-d5bf4f6af3a4 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:45.936495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b652-b448-4ace-8ab5-d5bf4f6af3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:45.936997 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b652-b448-4ace-8ab5-d5bf4f6af3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:45.965606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e917b652-b448-4ace-8ab5-d5bf4f6af3a4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:45.966785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fd532-7b22-45a4-9763-44efa644fe9f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:45.967078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fd532-7b22-45a4-9763-44efa644fe9f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:45.967361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fd532-7b22-45a4-9763-44efa644fe9f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:45.967866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e917b652-b448-4ace-8ab5-d5bf4f6af3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:45.969722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 228/456] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:45.975810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a853d-06e8-453b-93f5-01228960af02 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:45.976100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a853d-06e8-453b-93f5-01228960af02 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:45.976401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a853d-06e8-453b-93f5-01228960af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:45.976974 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 229/457] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:46.009032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1b2a853d-06e8-453b-93f5-01228960af02 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:46.010231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1b2a853d-06e8-453b-93f5-01228960af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:46.018736 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c54a6-0045-4caf-a5ba-204d8fda64a0 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.019777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c54a6-0045-4caf-a5ba-204d8fda64a0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.021266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 229/458] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:46.021777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c54a6-0045-4caf-a5ba-204d8fda64a0 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.023850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 230/459] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:46.029379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f4f08-e7ba-483c-8219-57adf8544d7b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.029903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f4f08-e7ba-483c-8219-57adf8544d7b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.030374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f4f08-e7ba-483c-8219-57adf8544d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.046297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c54a6-0045-4caf-a5ba-204d8fda64a0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.052780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-094f4f08-e7ba-483c-8219-57adf8544d7b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:46.054716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-094f4f08-e7ba-483c-8219-57adf8544d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:46.060419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c54a6-0045-4caf-a5ba-204d8fda64a0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.064504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3fed-1fe3-42a6-b574-eb1f181fa9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.064741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 230/460] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:46.065287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3fed-1fe3-42a6-b574-eb1f181fa9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.065539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f4f08-e7ba-483c-8219-57adf8544d7b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.065642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3fed-1fe3-42a6-b574-eb1f181fa9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.065829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3fed-1fe3-42a6-b574-eb1f181fa9f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.086793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f4f08-e7ba-483c-8219-57adf8544d7b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.092081 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c3fed-1fe3-42a6-b574-eb1f181fa9f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.093951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c3fed-1fe3-42a6-b574-eb1f181fa9f4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.094267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46566f-334d-4d20-95bf-b55d7ba07935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.095296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46566f-334d-4d20-95bf-b55d7ba07935 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.095771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46566f-334d-4d20-95bf-b55d7ba07935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.096236 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46566f-334d-4d20-95bf-b55d7ba07935 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.107580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46566f-334d-4d20-95bf-b55d7ba07935 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.109624 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46566f-334d-4d20-95bf-b55d7ba07935 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.111654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-131c3fed-1fe3-42a6-b574-eb1f181fa9f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:46.113228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 231/461] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:46.114103 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3fed-1fe3-42a6-b574-eb1f181fa9f4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.128237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6d46566f-334d-4d20-95bf-b55d7ba07935 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:46.129056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3fed-1fe3-42a6-b574-eb1f181fa9f4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.129911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 231/462] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:46.130860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46566f-334d-4d20-95bf-b55d7ba07935 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.134087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfbea-01e9-4afc-bd0c-dfeaa4ecbfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.135007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfbea-01e9-4afc-bd0c-dfeaa4ecbfbc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.135354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfbea-01e9-4afc-bd0c-dfeaa4ecbfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.135719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfbea-01e9-4afc-bd0c-dfeaa4ecbfbc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.141784 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46566f-334d-4d20-95bf-b55d7ba07935 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.147400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cfbea-01e9-4afc-bd0c-dfeaa4ecbfbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.150679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cfbea-01e9-4afc-bd0c-dfeaa4ecbfbc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.151921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a5be5-383a-4221-a4bf-0aa126a6930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.153187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a5be5-383a-4221-a4bf-0aa126a6930f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.153536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a5be5-383a-4221-a4bf-0aa126a6930f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.153852 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a5be5-383a-4221-a4bf-0aa126a6930f admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.155183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a5be5-383a-4221-a4bf-0aa126a6930f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:46.155665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a5be5-383a-4221-a4bf-0aa126a6930f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.157301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a5be5-383a-4221-a4bf-0aa126a6930f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.169752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 232/463] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:46.170387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a5be5-383a-4221-a4bf-0aa126a6930f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.173421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-af2cfbea-01e9-4afc-bd0c-dfeaa4ecbfbc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:46.175067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 232/464] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:46.176389 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfbea-01e9-4afc-bd0c-dfeaa4ecbfbc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.185976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a5be5-383a-4221-a4bf-0aa126a6930f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.190699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f80660-5734-4058-ad27-2fc146a36472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.191447 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f80660-5734-4058-ad27-2fc146a36472 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.191802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f80660-5734-4058-ad27-2fc146a36472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.192067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfbea-01e9-4afc-bd0c-dfeaa4ecbfbc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.192179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f80660-5734-4058-ad27-2fc146a36472 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.193206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f80660-5734-4058-ad27-2fc146a36472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:46.193508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f80660-5734-4058-ad27-2fc146a36472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.195341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f80660-5734-4058-ad27-2fc146a36472 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.196880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e02e91-b139-4d10-bb02-925b08037353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.197790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e02e91-b139-4d10-bb02-925b08037353 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.198622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e02e91-b139-4d10-bb02-925b08037353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.198971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e02e91-b139-4d10-bb02-925b08037353 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.199768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e02e91-b139-4d10-bb02-925b08037353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.202046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e02e91-b139-4d10-bb02-925b08037353 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.209454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 233/465] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:46.210426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f80660-5734-4058-ad27-2fc146a36472 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.220226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f80660-5734-4058-ad27-2fc146a36472 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.225286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82087721-b168-4515-8cc0-2074813d6a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.226663 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82087721-b168-4515-8cc0-2074813d6a0a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.227031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82087721-b168-4515-8cc0-2074813d6a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.227373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82087721-b168-4515-8cc0-2074813d6a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.228224 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82087721-b168-4515-8cc0-2074813d6a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:46.228622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82087721-b168-4515-8cc0-2074813d6a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.229050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 233/466] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:46 2022] POST /identity/v3/users => generated 246 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:46.229911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e02e91-b139-4d10-bb02-925b08037353 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.233930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82087721-b168-4515-8cc0-2074813d6a0a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.251844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 234/467] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:46.252752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e02e91-b139-4d10-bb02-925b08037353 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.253789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7464b86-61e4-4751-a01b-b1269348c935 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.254362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7464b86-61e4-4751-a01b-b1269348c935 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.254868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7464b86-61e4-4751-a01b-b1269348c935 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.260811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50675359-7f8a-405b-940b-8675ddbd4032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.260811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50675359-7f8a-405b-940b-8675ddbd4032 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.260811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50675359-7f8a-405b-940b-8675ddbd4032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.260811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50675359-7f8a-405b-940b-8675ddbd4032 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.261197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50675359-7f8a-405b-940b-8675ddbd4032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.261707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 235/468] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:46.262324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50675359-7f8a-405b-940b-8675ddbd4032 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.263250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7464b86-61e4-4751-a01b-b1269348c935 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.277242 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7464b86-61e4-4751-a01b-b1269348c935 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.282696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69d587-b6e6-4008-9d9e-ebf82ab08ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.283434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69d587-b6e6-4008-9d9e-ebf82ab08ece admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.283720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69d587-b6e6-4008-9d9e-ebf82ab08ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.283998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69d587-b6e6-4008-9d9e-ebf82ab08ece admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.284981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69d587-b6e6-4008-9d9e-ebf82ab08ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.286925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69d587-b6e6-4008-9d9e-ebf82ab08ece admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.288611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 234/469] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:46 2022] POST /identity/v3/users => generated 248 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:46.290182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70502528-0863-4686-bbff-fcab08d953be None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.290748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70502528-0863-4686-bbff-fcab08d953be None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.291277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70502528-0863-4686-bbff-fcab08d953be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.313749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-70502528-0863-4686-bbff-fcab08d953be None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:46.315807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-70502528-0863-4686-bbff-fcab08d953be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:46.326389 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 235/470] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:46.330333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 236/471] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:46 2022] POST /identity/v3/users => generated 248 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:28:46.382001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70502528-0863-4686-bbff-fcab08d953be None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.394768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70502528-0863-4686-bbff-fcab08d953be None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.402757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce17e79-2ad5-459f-8bbb-708927f86802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.403998 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce17e79-2ad5-459f-8bbb-708927f86802 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.404547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce17e79-2ad5-459f-8bbb-708927f86802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.405015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce17e79-2ad5-459f-8bbb-708927f86802 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.423424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce17e79-2ad5-459f-8bbb-708927f86802 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.425686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce17e79-2ad5-459f-8bbb-708927f86802 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.450083 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0ce17e79-2ad5-459f-8bbb-708927f86802 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:46.452483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 236/472] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:46.461605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69d587-b6e6-4008-9d9e-ebf82ab08ece admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.475276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69d587-b6e6-4008-9d9e-ebf82ab08ece admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.486154 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4eaf36-aadc-4aa6-9db4-084b3ea41a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.487245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eaf36-aadc-4aa6-9db4-084b3ea41a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.487774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eaf36-aadc-4aa6-9db4-084b3ea41a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.488267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4eaf36-aadc-4aa6-9db4-084b3ea41a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.489303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eaf36-aadc-4aa6-9db4-084b3ea41a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:46.489821 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eaf36-aadc-4aa6-9db4-084b3ea41a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.491726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4eaf36-aadc-4aa6-9db4-084b3ea41a72 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.516535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 237/473] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:46.522842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce17e79-2ad5-459f-8bbb-708927f86802 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:46.534623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce17e79-2ad5-459f-8bbb-708927f86802 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:46.541226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe70668-351f-40eb-9587-5ac2101ff710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:46.541895 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70668-351f-40eb-9587-5ac2101ff710 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:46.542173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70668-351f-40eb-9587-5ac2101ff710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:46.542445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe70668-351f-40eb-9587-5ac2101ff710 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:46.543171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe70668-351f-40eb-9587-5ac2101ff710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:46.545139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe70668-351f-40eb-9587-5ac2101ff710 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:46.568122 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 237/474] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:46 2022] POST /identity/v3/users => generated 249 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:47.138954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68614892-8405-4888-8595-c0fb89a9b639 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:47.139853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68614892-8405-4888-8595-c0fb89a9b639 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:47.140322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68614892-8405-4888-8595-c0fb89a9b639 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:47.142291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 238/475] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:47.147795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa477-1c0b-469b-a122-80b553905139 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:47.148257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa477-1c0b-469b-a122-80b553905139 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:47.148535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfa477-1c0b-469b-a122-80b553905139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:47.173352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1edfa477-1c0b-469b-a122-80b553905139 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:47.174537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1edfa477-1c0b-469b-a122-80b553905139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:47.183540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 238/476] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:47.206796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68614892-8405-4888-8595-c0fb89a9b639 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:47.221828 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68614892-8405-4888-8595-c0fb89a9b639 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:47.227049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:47.227719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:47.227995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:47.228265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:47.229069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:47.230658 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:47.245668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.sql.core [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 07 02:28:47.245668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 07 02:28:47.245668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [parameters: {'id': '8b26d38c2f9542218bea7a0dfccef807', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 07 02:28:47.245668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79276) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 07 02:28:47.260278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 07 02:28:47.261943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 239/477] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:28:47 2022] POST /identity/v3/roles => generated 144 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:47.267844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfa477-1c0b-469b-a122-80b553905139 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:47.277674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfa477-1c0b-469b-a122-80b553905139 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:47.293535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d08d23-d0ff-4f82-9d38-99baeef3be2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:47.294678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d08d23-d0ff-4f82-9d38-99baeef3be2b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:47.295158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d08d23-d0ff-4f82-9d38-99baeef3be2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:47.295656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d08d23-d0ff-4f82-9d38-99baeef3be2b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:47.317285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d08d23-d0ff-4f82-9d38-99baeef3be2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:47.324964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-43d08d23-d0ff-4f82-9d38-99baeef3be2b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 07 02:28:47.327042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 239/478] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:28:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:47.332845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:47.348399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c294-db04-4b8c-bc89-14efdf8c665c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:47.355368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b6462-86d8-427a-a4c6-418a346eb078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:47.356029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b6462-86d8-427a-a4c6-418a346eb078 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:47.356311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b6462-86d8-427a-a4c6-418a346eb078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:47.356608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b6462-86d8-427a-a4c6-418a346eb078 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:47.357375 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b6462-86d8-427a-a4c6-418a346eb078 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:47.357677 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b6462-86d8-427a-a4c6-418a346eb078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:47.359340 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b6462-86d8-427a-a4c6-418a346eb078 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:47.373110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 240/479] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:48.946797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb97c07-243a-4381-9f51-5e4ec5722316 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:48.947297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb97c07-243a-4381-9f51-5e4ec5722316 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:48.947297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb97c07-243a-4381-9f51-5e4ec5722316 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:48.949362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 240/480] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:48.955214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267071e1-44c5-4cdf-a689-5c386bcf9069 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:48.956080 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267071e1-44c5-4cdf-a689-5c386bcf9069 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:48.956619 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267071e1-44c5-4cdf-a689-5c386bcf9069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:48.981531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-267071e1-44c5-4cdf-a689-5c386bcf9069 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:48.982793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-267071e1-44c5-4cdf-a689-5c386bcf9069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:48.995983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 241/481] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:49.032292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb97c07-243a-4381-9f51-5e4ec5722316 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.056381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb97c07-243a-4381-9f51-5e4ec5722316 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.060906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf16fa-fc6a-403c-af38-f93801c9d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.061699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf16fa-fc6a-403c-af38-f93801c9d3cb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.061978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf16fa-fc6a-403c-af38-f93801c9d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.062247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf16fa-fc6a-403c-af38-f93801c9d3cb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.071792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd15be3-3f4f-4645-9e69-1e5d4fc7106d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.072131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd15be3-3f4f-4645-9e69-1e5d4fc7106d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.072367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd15be3-3f4f-4645-9e69-1e5d4fc7106d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.074455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 242/482] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:49.079098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf16fa-fc6a-403c-af38-f93801c9d3cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:49.079409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2954f-aedf-49aa-b04a-08c0a2019392 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.079697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2954f-aedf-49aa-b04a-08c0a2019392 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.079978 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2954f-aedf-49aa-b04a-08c0a2019392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.086276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-3fdf16fa-fc6a-403c-af38-f93801c9d3cb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:49.087845 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 241/483] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.092940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf16fa-fc6a-403c-af38-f93801c9d3cb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.115522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf16fa-fc6a-403c-af38-f93801c9d3cb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.118165 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-39c2954f-aedf-49aa-b04a-08c0a2019392 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:49.120484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-39c2954f-aedf-49aa-b04a-08c0a2019392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:49.133399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc595b6-4430-41a1-8f5e-3ece3c46c451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.135690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc595b6-4430-41a1-8f5e-3ece3c46c451 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.138078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc595b6-4430-41a1-8f5e-3ece3c46c451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.138842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc595b6-4430-41a1-8f5e-3ece3c46c451 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.142759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc595b6-4430-41a1-8f5e-3ece3c46c451 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.143617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc595b6-4430-41a1-8f5e-3ece3c46c451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.147599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc595b6-4430-41a1-8f5e-3ece3c46c451 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.151042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 243/484] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:49.167096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 242/485] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:49.175898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2954f-aedf-49aa-b04a-08c0a2019392 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.191408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc595b6-4430-41a1-8f5e-3ece3c46c451 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.204541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2954f-aedf-49aa-b04a-08c0a2019392 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.212601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5043c-84e1-4452-9815-aebb9980d019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.214299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5043c-84e1-4452-9815-aebb9980d019 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.215040 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5043c-84e1-4452-9815-aebb9980d019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.215774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5043c-84e1-4452-9815-aebb9980d019 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.218678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc595b6-4430-41a1-8f5e-3ece3c46c451 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.235201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbdb86-7480-4d32-8673-fe80335f0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.238622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbdb86-7480-4d32-8673-fe80335f0cdd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.239393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbdb86-7480-4d32-8673-fe80335f0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.240143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbdb86-7480-4d32-8673-fe80335f0cdd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.243510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5043c-84e1-4452-9815-aebb9980d019 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.247696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5043c-84e1-4452-9815-aebb9980d019 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.282685 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbdb86-7480-4d32-8673-fe80335f0cdd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:49.309425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-47bbdb86-7480-4d32-8673-fe80335f0cdd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:49.312779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-3cc5043c-84e1-4452-9815-aebb9980d019 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:49.315395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 243/486] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.317770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 244/487] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:49.320916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbdb86-7480-4d32-8673-fe80335f0cdd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.325377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5043c-84e1-4452-9815-aebb9980d019 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.338603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbdb86-7480-4d32-8673-fe80335f0cdd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.340871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5043c-84e1-4452-9815-aebb9980d019 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.347608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c37a3d-539f-41f8-8a0a-7603c8fbd626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.348588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37a3d-539f-41f8-8a0a-7603c8fbd626 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.349278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37a3d-539f-41f8-8a0a-7603c8fbd626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.349844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c37a3d-539f-41f8-8a0a-7603c8fbd626 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.350866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c90d93-2cec-40a5-9272-6a3f945736d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.351526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90d93-2cec-40a5-9272-6a3f945736d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.351761 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c37a3d-539f-41f8-8a0a-7603c8fbd626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.352251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c37a3d-539f-41f8-8a0a-7603c8fbd626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.354060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c37a3d-539f-41f8-8a0a-7603c8fbd626 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.356542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90d93-2cec-40a5-9272-6a3f945736d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.356831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90d93-2cec-40a5-9272-6a3f945736d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.358166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c90d93-2cec-40a5-9272-6a3f945736d6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.358477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c90d93-2cec-40a5-9272-6a3f945736d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.360085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c90d93-2cec-40a5-9272-6a3f945736d6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.368273 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 245/488] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.373129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c37a3d-539f-41f8-8a0a-7603c8fbd626 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.374072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 244/489] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:49.379306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c90d93-2cec-40a5-9272-6a3f945736d6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.383606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c37a3d-539f-41f8-8a0a-7603c8fbd626 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.388490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6814fb-eac2-436e-b04c-ea5d997edc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.390024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6814fb-eac2-436e-b04c-ea5d997edc18 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.390508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6814fb-eac2-436e-b04c-ea5d997edc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.391121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6814fb-eac2-436e-b04c-ea5d997edc18 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.396131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c90d93-2cec-40a5-9272-6a3f945736d6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.400372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6814fb-eac2-436e-b04c-ea5d997edc18 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.402040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd31c3-b637-4a29-9582-7ef906df7d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.402822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd31c3-b637-4a29-9582-7ef906df7d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.403097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd31c3-b637-4a29-9582-7ef906df7d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.403371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd31c3-b637-4a29-9582-7ef906df7d11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.403924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6814fb-eac2-436e-b04c-ea5d997edc18 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.415415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd31c3-b637-4a29-9582-7ef906df7d11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.417282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd31c3-b637-4a29-9582-7ef906df7d11 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.421354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-4b6814fb-eac2-436e-b04c-ea5d997edc18 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 02:28:49.423127 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 246/490] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:49.424985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe292226-eb42-48e8-a8f1-fd7a612b1f61 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.425476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe292226-eb42-48e8-a8f1-fd7a612b1f61 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.425959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe292226-eb42-48e8-a8f1-fd7a612b1f61 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.428177 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 247/491] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:49.430097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe292226-eb42-48e8-a8f1-fd7a612b1f61 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.441538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-ecdd31c3-b637-4a29-9582-7ef906df7d11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:49.442987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe292226-eb42-48e8-a8f1-fd7a612b1f61 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.443097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 245/492] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.444435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc902a3e-c631-48f5-b00c-88d04628a820 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.444722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc902a3e-c631-48f5-b00c-88d04628a820 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.445000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc902a3e-c631-48f5-b00c-88d04628a820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.448767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.449809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.450323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.451052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.453280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.453794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.455050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:49.455050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:28:49.455050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:28:49.456575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.464178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-cc902a3e-c631-48f5-b00c-88d04628a820 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:49.465683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cc902a3e-c631-48f5-b00c-88d04628a820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:49.473648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 246/493] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:49.474654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc902a3e-c631-48f5-b00c-88d04628a820 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.495868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc902a3e-c631-48f5-b00c-88d04628a820 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.505040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.505725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.506100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.506432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.507259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.507660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.508739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:49.508739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:28:49.508739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:28:49.509802 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.512975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 248/494] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.514130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.525437 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d45b66-bc5c-4f0c-ae3a-07f5a672af35 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.531379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b203f26-4478-412f-acce-7a0aa3d88298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.532746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b203f26-4478-412f-acce-7a0aa3d88298 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.533306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b203f26-4478-412f-acce-7a0aa3d88298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.533829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b203f26-4478-412f-acce-7a0aa3d88298 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.534314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 247/495] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.535447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.550350 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3a2b-e50c-4828-afa0-05fb67a45411 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.554141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b203f26-4478-412f-acce-7a0aa3d88298 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:49.557628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf225-b0ea-464b-9fcc-b1e335d172dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.558910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf225-b0ea-464b-9fcc-b1e335d172dc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.559535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf225-b0ea-464b-9fcc-b1e335d172dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.560231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf225-b0ea-464b-9fcc-b1e335d172dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.561296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-4b203f26-4478-412f-acce-7a0aa3d88298 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:49.567642 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 249/496] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.568510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b203f26-4478-412f-acce-7a0aa3d88298 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.571878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf225-b0ea-464b-9fcc-b1e335d172dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.573875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf225-b0ea-464b-9fcc-b1e335d172dc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.579408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b203f26-4478-412f-acce-7a0aa3d88298 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.584211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b451-0ce0-4857-8d93-31bd77742f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.585654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b451-0ce0-4857-8d93-31bd77742f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.586050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 248/497] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:49.586965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf225-b0ea-464b-9fcc-b1e335d172dc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.588523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b451-0ce0-4857-8d93-31bd77742f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.588979 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b451-0ce0-4857-8d93-31bd77742f9d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.599213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf225-b0ea-464b-9fcc-b1e335d172dc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.601341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6b451-0ce0-4857-8d93-31bd77742f9d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.603869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6b451-0ce0-4857-8d93-31bd77742f9d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.605069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af5731-e605-4025-be5b-083064d1c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.606067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af5731-e605-4025-be5b-083064d1c13c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.606518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af5731-e605-4025-be5b-083064d1c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.607397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af5731-e605-4025-be5b-083064d1c13c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.608314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af5731-e605-4025-be5b-083064d1c13c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.608821 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af5731-e605-4025-be5b-083064d1c13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.610685 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af5731-e605-4025-be5b-083064d1c13c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.618492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d6d6b451-0ce0-4857-8d93-31bd77742f9d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 07 02:28:49.619368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 249/498] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.620301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af5731-e605-4025-be5b-083064d1c13c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.626736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 250/499] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.626736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b451-0ce0-4857-8d93-31bd77742f9d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.640855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af5731-e605-4025-be5b-083064d1c13c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.641019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b451-0ce0-4857-8d93-31bd77742f9d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.645908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0b609-88f8-4081-80db-ea2a5ffce12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.646055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2074eb4-8335-4c3e-b10c-55859d626f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.646883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2074eb4-8335-4c3e-b10c-55859d626f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.647730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b609-88f8-4081-80db-ea2a5ffce12e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.647831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2074eb4-8335-4c3e-b10c-55859d626f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.648161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2074eb4-8335-4c3e-b10c-55859d626f3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.648492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b609-88f8-4081-80db-ea2a5ffce12e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.649002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b609-88f8-4081-80db-ea2a5ffce12e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.660196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2074eb4-8335-4c3e-b10c-55859d626f3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.661929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0b609-88f8-4081-80db-ea2a5ffce12e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.662314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2074eb4-8335-4c3e-b10c-55859d626f3e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.664993 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0b609-88f8-4081-80db-ea2a5ffce12e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.684791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a2074eb4-8335-4c3e-b10c-55859d626f3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:49.686142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 251/500] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.687085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-7ee0b609-88f8-4081-80db-ea2a5ffce12e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:49.688704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 250/501] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.692197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2074eb4-8335-4c3e-b10c-55859d626f3e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.697445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0b609-88f8-4081-80db-ea2a5ffce12e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.704095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2074eb4-8335-4c3e-b10c-55859d626f3e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.708720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0b609-88f8-4081-80db-ea2a5ffce12e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.709446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88821f5b-2539-4efb-84a0-f1cc85b8ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.711026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88821f5b-2539-4efb-84a0-f1cc85b8ead7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.711507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88821f5b-2539-4efb-84a0-f1cc85b8ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.712038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88821f5b-2539-4efb-84a0-f1cc85b8ead7 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.713331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88821f5b-2539-4efb-84a0-f1cc85b8ead7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.713639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806ddd-f857-4846-ab20-ea84571abfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.714123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88821f5b-2539-4efb-84a0-f1cc85b8ead7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.714293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806ddd-f857-4846-ab20-ea84571abfbc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.714539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806ddd-f857-4846-ab20-ea84571abfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.714809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806ddd-f857-4846-ab20-ea84571abfbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.715529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5806ddd-f857-4846-ab20-ea84571abfbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.715843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5806ddd-f857-4846-ab20-ea84571abfbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.717332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88821f5b-2539-4efb-84a0-f1cc85b8ead7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.717439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5806ddd-f857-4846-ab20-ea84571abfbc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.736491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 251/502] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:49.736491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806ddd-f857-4846-ab20-ea84571abfbc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.743864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 252/503] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.745033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88821f5b-2539-4efb-84a0-f1cc85b8ead7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.751115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806ddd-f857-4846-ab20-ea84571abfbc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.755679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb586fb-20fb-4c0a-9087-d72096a82934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.756269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb586fb-20fb-4c0a-9087-d72096a82934 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.756612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb586fb-20fb-4c0a-9087-d72096a82934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.756882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb586fb-20fb-4c0a-9087-d72096a82934 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.757604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb586fb-20fb-4c0a-9087-d72096a82934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.757898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb586fb-20fb-4c0a-9087-d72096a82934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.759492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb586fb-20fb-4c0a-9087-d72096a82934 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.760933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88821f5b-2539-4efb-84a0-f1cc85b8ead7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.765831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f00c1-a8d1-4cbd-ad4f-273447f26157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.766867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f00c1-a8d1-4cbd-ad4f-273447f26157 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.767404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f00c1-a8d1-4cbd-ad4f-273447f26157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.767972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f00c1-a8d1-4cbd-ad4f-273447f26157 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.776035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 252/504] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.776805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f00c1-a8d1-4cbd-ad4f-273447f26157 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.776985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb586fb-20fb-4c0a-9087-d72096a82934 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.779306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f00c1-a8d1-4cbd-ad4f-273447f26157 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.786336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb586fb-20fb-4c0a-9087-d72096a82934 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.791266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27e9e1-0b4d-42f1-8a22-c84e0b0fc371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.791887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27e9e1-0b4d-42f1-8a22-c84e0b0fc371 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.792163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27e9e1-0b4d-42f1-8a22-c84e0b0fc371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.792463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27e9e1-0b4d-42f1-8a22-c84e0b0fc371 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.793689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-863f00c1-a8d1-4cbd-ad4f-273447f26157 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:49.796054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 253/505] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.796054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f00c1-a8d1-4cbd-ad4f-273447f26157 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.803239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27e9e1-0b4d-42f1-8a22-c84e0b0fc371 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.805112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27e9e1-0b4d-42f1-8a22-c84e0b0fc371 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.811303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f00c1-a8d1-4cbd-ad4f-273447f26157 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.814214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 253/506] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:49.818523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a74ab6-6057-40e6-80fd-6665ac06d953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.818523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74ab6-6057-40e6-80fd-6665ac06d953 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.818523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74ab6-6057-40e6-80fd-6665ac06d953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.818523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74ab6-6057-40e6-80fd-6665ac06d953 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.821259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7b31-94cc-4e95-a294-0a6ca3a45366 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.821643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7b31-94cc-4e95-a294-0a6ca3a45366 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.822011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f7b31-94cc-4e95-a294-0a6ca3a45366 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.828193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 254/507] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:49.828193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7b31-94cc-4e95-a294-0a6ca3a45366 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.829650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a74ab6-6057-40e6-80fd-6665ac06d953 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.831722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a74ab6-6057-40e6-80fd-6665ac06d953 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.840769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f7b31-94cc-4e95-a294-0a6ca3a45366 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.845062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a41c0-a080-49a7-ac4c-820010f22816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.845751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a41c0-a080-49a7-ac4c-820010f22816 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.846100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a41c0-a080-49a7-ac4c-820010f22816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.846302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-88a74ab6-6057-40e6-80fd-6665ac06d953 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 07 02:28:49.846505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a41c0-a080-49a7-ac4c-820010f22816 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.847355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a41c0-a080-49a7-ac4c-820010f22816 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.847690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 254/508] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.848478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a74ab6-6057-40e6-80fd-6665ac06d953 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.852032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a41c0-a080-49a7-ac4c-820010f22816 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.853150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-0c0a41c0-a080-49a7-ac4c-820010f22816 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:49.853150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:28:49.853150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:28:49.854276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a41c0-a080-49a7-ac4c-820010f22816 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.858311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a74ab6-6057-40e6-80fd-6665ac06d953 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.862589 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e1834-3429-4860-ab6d-163600340333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.863345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1834-3429-4860-ab6d-163600340333 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.863625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1834-3429-4860-ab6d-163600340333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.863894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e1834-3429-4860-ab6d-163600340333 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.876303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 255/509] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.876303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8461422-177f-4284-b58f-d44bba03b388 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.876303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8461422-177f-4284-b58f-d44bba03b388 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.876303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8461422-177f-4284-b58f-d44bba03b388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.879595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e1834-3429-4860-ab6d-163600340333 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.882159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e1834-3429-4860-ab6d-163600340333 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.893041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c8461422-177f-4284-b58f-d44bba03b388 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:49.894198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c8461422-177f-4284-b58f-d44bba03b388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:49.899329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-9b7e1834-3429-4860-ab6d-163600340333 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:49.905141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 255/510] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.905141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e1834-3429-4860-ab6d-163600340333 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.907723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 256/511] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:49.907723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8461422-177f-4284-b58f-d44bba03b388 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.917773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e1834-3429-4860-ab6d-163600340333 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.922420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91b741-909b-47fb-b07e-0cf55d70c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.922980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8461422-177f-4284-b58f-d44bba03b388 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.923287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b741-909b-47fb-b07e-0cf55d70c10a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.923673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b741-909b-47fb-b07e-0cf55d70c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.924064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b741-909b-47fb-b07e-0cf55d70c10a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.925101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91b741-909b-47fb-b07e-0cf55d70c10a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.925541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91b741-909b-47fb-b07e-0cf55d70c10a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.927457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91b741-909b-47fb-b07e-0cf55d70c10a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.928746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a11aa-570d-41f3-924d-80473b6d653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.929770 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a11aa-570d-41f3-924d-80473b6d653c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.931087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a11aa-570d-41f3-924d-80473b6d653c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.931522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a11aa-570d-41f3-924d-80473b6d653c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.932393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a11aa-570d-41f3-924d-80473b6d653c admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=904a4e5f54e642eda58c90930b5858f4) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.932719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a11aa-570d-41f3-924d-80473b6d653c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.934538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a11aa-570d-41f3-924d-80473b6d653c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.940415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 257/512] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/role_assignments?user.id=904a4e5f54e642eda58c90930b5858f4&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.941666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a11aa-570d-41f3-924d-80473b6d653c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.947426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 256/513] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.948465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91b741-909b-47fb-b07e-0cf55d70c10a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.956127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a11aa-570d-41f3-924d-80473b6d653c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.961447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4fbd7-0c77-471b-b54a-07220f071d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.962064 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4fbd7-0c77-471b-b54a-07220f071d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.962324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4fbd7-0c77-471b-b54a-07220f071d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.962596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4fbd7-0c77-471b-b54a-07220f071d11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.963339 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4fbd7-0c77-471b-b54a-07220f071d11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:49.963638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4fbd7-0c77-471b-b54a-07220f071d11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:49.963741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91b741-909b-47fb-b07e-0cf55d70c10a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.965429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4fbd7-0c77-471b-b54a-07220f071d11 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:49.969152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225af745-8ddb-4e91-a4de-99f04ae5372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.970186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af745-8ddb-4e91-a4de-99f04ae5372a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.970617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af745-8ddb-4e91-a4de-99f04ae5372a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.970989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225af745-8ddb-4e91-a4de-99f04ae5372a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:49.979323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 258/514] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:49.980187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4fbd7-0c77-471b-b54a-07220f071d11 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.984461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225af745-8ddb-4e91-a4de-99f04ae5372a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:49.989703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4fbd7-0c77-471b-b54a-07220f071d11 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:49.992518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-225af745-8ddb-4e91-a4de-99f04ae5372a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:49.994400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 257/515] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:49.994563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc4277-abfd-49ce-a07f-2debb5375a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:49.995287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc4277-abfd-49ce-a07f-2debb5375a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:49.995398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225af745-8ddb-4e91-a4de-99f04ae5372a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:49.995782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc4277-abfd-49ce-a07f-2debb5375a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:49.996086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc4277-abfd-49ce-a07f-2debb5375a39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.005070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc4277-abfd-49ce-a07f-2debb5375a39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.006305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225af745-8ddb-4e91-a4de-99f04ae5372a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.007598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc4277-abfd-49ce-a07f-2debb5375a39 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.011904 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfc302-3b4a-444a-85cc-86e7ed82acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.012890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfc302-3b4a-444a-85cc-86e7ed82acb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.013237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfc302-3b4a-444a-85cc-86e7ed82acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.013583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfc302-3b4a-444a-85cc-86e7ed82acb4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.018103 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 259/516] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:50.023785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfc302-3b4a-444a-85cc-86e7ed82acb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.024495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc4277-abfd-49ce-a07f-2debb5375a39 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.026352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfc302-3b4a-444a-85cc-86e7ed82acb4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.034861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc4277-abfd-49ce-a07f-2debb5375a39 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.040107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b507c-2b84-412a-9c35-d06ebe5ff697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.041057 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b507c-2b84-412a-9c35-d06ebe5ff697 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.041507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b507c-2b84-412a-9c35-d06ebe5ff697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.041973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b507c-2b84-412a-9c35-d06ebe5ff697 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.042088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-1ebfc302-3b4a-444a-85cc-86e7ed82acb4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:50.043011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b507c-2b84-412a-9c35-d06ebe5ff697 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.043485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b507c-2b84-412a-9c35-d06ebe5ff697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.043584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 258/517] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:50.044547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfc302-3b4a-444a-85cc-86e7ed82acb4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.045875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b507c-2b84-412a-9c35-d06ebe5ff697 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.055448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfc302-3b4a-444a-85cc-86e7ed82acb4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.056211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 260/518] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:50.057233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b507c-2b84-412a-9c35-d06ebe5ff697 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.060537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1e5e3-cd27-4db8-a7b2-8d79e286c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.061407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1e5e3-cd27-4db8-a7b2-8d79e286c081 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.061806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1e5e3-cd27-4db8-a7b2-8d79e286c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.062177 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1e5e3-cd27-4db8-a7b2-8d79e286c081 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.074485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b507c-2b84-412a-9c35-d06ebe5ff697 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.079032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1e5e3-cd27-4db8-a7b2-8d79e286c081 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.080896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4e01-f309-461f-8602-ad21e88dbbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.081458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1e5e3-cd27-4db8-a7b2-8d79e286c081 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.082149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4e01-f309-461f-8602-ad21e88dbbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.082668 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4e01-f309-461f-8602-ad21e88dbbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.083118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4e01-f309-461f-8602-ad21e88dbbd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.084501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4e01-f309-461f-8602-ad21e88dbbd3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.086101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4e01-f309-461f-8602-ad21e88dbbd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.088305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4e01-f309-461f-8602-ad21e88dbbd3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.102091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-bdc1e5e3-cd27-4db8-a7b2-8d79e286c081 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:50.103818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 261/520] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:50.104971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4e01-f309-461f-8602-ad21e88dbbd3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.108055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 259/520] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:50.113197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1e5e3-cd27-4db8-a7b2-8d79e286c081 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.120206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4e01-f309-461f-8602-ad21e88dbbd3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.124885 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1e5e3-cd27-4db8-a7b2-8d79e286c081 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.126293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666b055-1be4-44f5-aaae-6b238c36c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.127476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666b055-1be4-44f5-aaae-6b238c36c5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.127966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666b055-1be4-44f5-aaae-6b238c36c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.128416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666b055-1be4-44f5-aaae-6b238c36c5b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.130008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b6546-7464-4dbc-a1b0-97f911e29022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.130771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b6546-7464-4dbc-a1b0-97f911e29022 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.131150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b6546-7464-4dbc-a1b0-97f911e29022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.132128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b6546-7464-4dbc-a1b0-97f911e29022 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.132965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b6546-7464-4dbc-a1b0-97f911e29022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.133608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b6546-7464-4dbc-a1b0-97f911e29022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.135101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b6546-7464-4dbc-a1b0-97f911e29022 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.142754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666b055-1be4-44f5-aaae-6b238c36c5b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.144996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666b055-1be4-44f5-aaae-6b238c36c5b0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.149282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 260/521] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:50.153908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b6546-7464-4dbc-a1b0-97f911e29022 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.167112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b6546-7464-4dbc-a1b0-97f911e29022 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.168729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-4666b055-1be4-44f5-aaae-6b238c36c5b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:50.170115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 262/522] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:50.171107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666b055-1be4-44f5-aaae-6b238c36c5b0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.173248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb60b5-fd2c-4837-a5a7-fe48d2992175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.174092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb60b5-fd2c-4837-a5a7-fe48d2992175 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.174517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb60b5-fd2c-4837-a5a7-fe48d2992175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.175165 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb60b5-fd2c-4837-a5a7-fe48d2992175 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.176153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb60b5-fd2c-4837-a5a7-fe48d2992175 admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=612a02fb42af490abcba0e75ec8c759f) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.176892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb60b5-fd2c-4837-a5a7-fe48d2992175 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.181315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb60b5-fd2c-4837-a5a7-fe48d2992175 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.182281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666b055-1be4-44f5-aaae-6b238c36c5b0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.186791 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bada0-974b-4ce5-ac70-cbbada8ffcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.187581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bada0-974b-4ce5-ac70-cbbada8ffcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.187842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bada0-974b-4ce5-ac70-cbbada8ffcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.188114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bada0-974b-4ce5-ac70-cbbada8ffcf3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.190014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 261/523] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/role_assignments?user.id=612a02fb42af490abcba0e75ec8c759f&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:50.191157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb60b5-fd2c-4837-a5a7-fe48d2992175 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.196911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bada0-974b-4ce5-ac70-cbbada8ffcf3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.198904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0bada0-974b-4ce5-ac70-cbbada8ffcf3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.206976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb60b5-fd2c-4837-a5a7-fe48d2992175 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.212647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c69387-1cb6-4837-9bc4-f08e76fcb060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.213702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c69387-1cb6-4837-9bc4-f08e76fcb060 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.214187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c69387-1cb6-4837-9bc4-f08e76fcb060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.214713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c69387-1cb6-4837-9bc4-f08e76fcb060 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.214817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-db0bada0-974b-4ce5-ac70-cbbada8ffcf3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:50.215873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c69387-1cb6-4837-9bc4-f08e76fcb060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.216064 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 263/524] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:50.216564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c69387-1cb6-4837-9bc4-f08e76fcb060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.218574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c69387-1cb6-4837-9bc4-f08e76fcb060 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.229645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bada0-974b-4ce5-ac70-cbbada8ffcf3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.239569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 262/525] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:50.247070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bada0-974b-4ce5-ac70-cbbada8ffcf3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.248302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c69387-1cb6-4837-9bc4-f08e76fcb060 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.259574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c69387-1cb6-4837-9bc4-f08e76fcb060 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.262443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e0b7f-9932-484d-97f3-d0f2304496a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.263213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e0b7f-9932-484d-97f3-d0f2304496a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.263495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e0b7f-9932-484d-97f3-d0f2304496a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.263763 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e0b7f-9932-484d-97f3-d0f2304496a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.264638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e0b7f-9932-484d-97f3-d0f2304496a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.264943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e0b7f-9932-484d-97f3-d0f2304496a7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.266085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3380d-f37f-469a-8603-4f91d9dade43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.266902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e0b7f-9932-484d-97f3-d0f2304496a7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.267302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3380d-f37f-469a-8603-4f91d9dade43 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.267793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3380d-f37f-469a-8603-4f91d9dade43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.268272 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3380d-f37f-469a-8603-4f91d9dade43 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.277315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3380d-f37f-469a-8603-4f91d9dade43 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.279818 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3380d-f37f-469a-8603-4f91d9dade43 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.288323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 264/526] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:50.297465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e0b7f-9932-484d-97f3-d0f2304496a7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.301072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-42e3380d-f37f-469a-8603-4f91d9dade43 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 07 02:28:50.302698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 263/527] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:50.310989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e0b7f-9932-484d-97f3-d0f2304496a7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.312303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3380d-f37f-469a-8603-4f91d9dade43 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.326822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3380d-f37f-469a-8603-4f91d9dade43 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.330756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c6f0e-960e-492e-9ed8-2c6764f05c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.332172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6f0e-960e-492e-9ed8-2c6764f05c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.333223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6f0e-960e-492e-9ed8-2c6764f05c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.334223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c6f0e-960e-492e-9ed8-2c6764f05c1f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.335363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c6f0e-960e-492e-9ed8-2c6764f05c1f admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=2e738156764e4b038adc89cf114ccda3) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.337276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c6f0e-960e-492e-9ed8-2c6764f05c1f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.339380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397c3f4-c0a6-49d5-be94-a480dc43f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.340376 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397c3f4-c0a6-49d5-be94-a480dc43f321 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.341360 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397c3f4-c0a6-49d5-be94-a480dc43f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.342471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397c3f4-c0a6-49d5-be94-a480dc43f321 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.343551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397c3f4-c0a6-49d5-be94-a480dc43f321 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.343748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c6f0e-960e-492e-9ed8-2c6764f05c1f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.346678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397c3f4-c0a6-49d5-be94-a480dc43f321 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.349434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397c3f4-c0a6-49d5-be94-a480dc43f321 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.351232 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 265/528] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/role_assignments?user.id=2e738156764e4b038adc89cf114ccda3&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:50.362142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e569cb-1fce-4fe9-bd0c-3a4be5f328f8 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.362858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e569cb-1fce-4fe9-bd0c-3a4be5f328f8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.363365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e569cb-1fce-4fe9-bd0c-3a4be5f328f8 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.366341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 266/529] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:50.371961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f181-c5a9-4b01-a027-520cf2b427b7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.372600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f181-c5a9-4b01-a027-520cf2b427b7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.373080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f181-c5a9-4b01-a027-520cf2b427b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.379341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 264/530] 10.222.0.15 () {56 vars in 1160 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:50.389478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397c3f4-c0a6-49d5-be94-a480dc43f321 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.400772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397c3f4-c0a6-49d5-be94-a480dc43f321 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.403211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d8a4f181-c5a9-4b01-a027-520cf2b427b7 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:50.405045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d8a4f181-c5a9-4b01-a027-520cf2b427b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:50.414352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811bcaa-b529-421b-a534-0ed7f49ad67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.415683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811bcaa-b529-421b-a534-0ed7f49ad67a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.416582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811bcaa-b529-421b-a534-0ed7f49ad67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.417349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811bcaa-b529-421b-a534-0ed7f49ad67a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.421873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 267/531] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:50.433751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811bcaa-b529-421b-a534-0ed7f49ad67a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.435833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811bcaa-b529-421b-a534-0ed7f49ad67a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.447498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 265/532] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:50.448851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4f181-c5a9-4b01-a027-520cf2b427b7 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.453303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811bcaa-b529-421b-a534-0ed7f49ad67a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.462120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4f181-c5a9-4b01-a027-520cf2b427b7 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.465014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811bcaa-b529-421b-a534-0ed7f49ad67a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.472483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b31a92-57ea-4a21-88ae-07b895d9f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.473295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b31a92-57ea-4a21-88ae-07b895d9f975 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.473571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b31a92-57ea-4a21-88ae-07b895d9f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.473839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b31a92-57ea-4a21-88ae-07b895d9f975 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.475044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5a398-5123-4fb2-bd1d-3a4c20d4c19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.475872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5a398-5123-4fb2-bd1d-3a4c20d4c19e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.476144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5a398-5123-4fb2-bd1d-3a4c20d4c19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.476505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5a398-5123-4fb2-bd1d-3a4c20d4c19e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.495905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b31a92-57ea-4a21-88ae-07b895d9f975 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.497895 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b31a92-57ea-4a21-88ae-07b895d9f975 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.499174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5a398-5123-4fb2-bd1d-3a4c20d4c19e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.501020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5a398-5123-4fb2-bd1d-3a4c20d4c19e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.535729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-5fb5a398-5123-4fb2-bd1d-3a4c20d4c19e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:50.537013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 266/533] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:50.537443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-e1b31a92-57ea-4a21-88ae-07b895d9f975 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:50.539193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 268/534] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:50.545420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5a398-5123-4fb2-bd1d-3a4c20d4c19e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.546737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b31a92-57ea-4a21-88ae-07b895d9f975 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.560107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b31a92-57ea-4a21-88ae-07b895d9f975 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.565107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3a8cd-d747-4fba-8962-0b20c0eb13c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.566035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3a8cd-d747-4fba-8962-0b20c0eb13c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.566334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5a398-5123-4fb2-bd1d-3a4c20d4c19e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.566741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3a8cd-d747-4fba-8962-0b20c0eb13c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.567280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3a8cd-d747-4fba-8962-0b20c0eb13c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.569021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3a8cd-d747-4fba-8962-0b20c0eb13c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.570027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3a8cd-d747-4fba-8962-0b20c0eb13c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.571884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3a8cd-d747-4fba-8962-0b20c0eb13c2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.576650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95d18-fb55-4ba7-a797-68c117956235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.577313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95d18-fb55-4ba7-a797-68c117956235 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.577649 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95d18-fb55-4ba7-a797-68c117956235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.577925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95d18-fb55-4ba7-a797-68c117956235 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.578664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e95d18-fb55-4ba7-a797-68c117956235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.578971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e95d18-fb55-4ba7-a797-68c117956235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.581157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e95d18-fb55-4ba7-a797-68c117956235 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.586525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 269/535] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:50.592273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3a8cd-d747-4fba-8962-0b20c0eb13c2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.601292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 267/536] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:50.603989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3a8cd-d747-4fba-8962-0b20c0eb13c2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.606576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95d18-fb55-4ba7-a797-68c117956235 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.609377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5115db-5d9b-4dfe-8d46-f8062da6130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.610162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5115db-5d9b-4dfe-8d46-f8062da6130c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.610435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5115db-5d9b-4dfe-8d46-f8062da6130c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.610703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5115db-5d9b-4dfe-8d46-f8062da6130c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.618706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5115db-5d9b-4dfe-8d46-f8062da6130c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.620233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95d18-fb55-4ba7-a797-68c117956235 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.621367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5115db-5d9b-4dfe-8d46-f8062da6130c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.625867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a44ee-b0cf-4421-a46d-557d7ed6b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.626775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a44ee-b0cf-4421-a46d-557d7ed6b0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.627259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a44ee-b0cf-4421-a46d-557d7ed6b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.627816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a44ee-b0cf-4421-a46d-557d7ed6b0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.629085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a44ee-b0cf-4421-a46d-557d7ed6b0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.631216 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a44ee-b0cf-4421-a46d-557d7ed6b0c3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.637797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0a5115db-5d9b-4dfe-8d46-f8062da6130c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:50.643549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 270/537] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:50.645419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5115db-5d9b-4dfe-8d46-f8062da6130c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.662314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 268/538] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:28:50 2022] POST /identity/v3/users => generated 247 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:28:50.664261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5115db-5d9b-4dfe-8d46-f8062da6130c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.669139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d0732-1f60-42a6-b736-1e2e95033752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.669823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d0732-1f60-42a6-b736-1e2e95033752 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.670161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d0732-1f60-42a6-b736-1e2e95033752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.670432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d0732-1f60-42a6-b736-1e2e95033752 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.671296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d0732-1f60-42a6-b736-1e2e95033752 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.671602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d0732-1f60-42a6-b736-1e2e95033752 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.673700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d0732-1f60-42a6-b736-1e2e95033752 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.691833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 271/539] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:50.698291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a44ee-b0cf-4421-a46d-557d7ed6b0c3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:50.710946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a44ee-b0cf-4421-a46d-557d7ed6b0c3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:50.719278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610819d-3976-406e-9c3b-a73e4f8c9db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:50.719930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610819d-3976-406e-9c3b-a73e4f8c9db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:50.720217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610819d-3976-406e-9c3b-a73e4f8c9db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:50.720522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610819d-3976-406e-9c3b-a73e4f8c9db2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:50.721666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610819d-3976-406e-9c3b-a73e4f8c9db2 admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=b3922641f7c846da98457824bec58652) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:50.721990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610819d-3976-406e-9c3b-a73e4f8c9db2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:50.723992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610819d-3976-406e-9c3b-a73e4f8c9db2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:50.737184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 269/540] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:50 2022] GET /identity/v3/role_assignments?user.id=b3922641f7c846da98457824bec58652&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:52.714004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f15c2-ee96-40bc-9c20-bf7f11cc29f2 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:52.714540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f15c2-ee96-40bc-9c20-bf7f11cc29f2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:52.714540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f15c2-ee96-40bc-9c20-bf7f11cc29f2 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:52.716620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 272/541] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:52.721775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2694-318f-405e-8a46-f2e0fcd854f4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:52.722184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2694-318f-405e-8a46-f2e0fcd854f4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:52.722356 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d2694-318f-405e-8a46-f2e0fcd854f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:52.746470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d14d2694-318f-405e-8a46-f2e0fcd854f4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:52.747635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d14d2694-318f-405e-8a46-f2e0fcd854f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:52.760254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 270/542] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:52.786929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f15c2-ee96-40bc-9c20-bf7f11cc29f2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:52.802330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f15c2-ee96-40bc-9c20-bf7f11cc29f2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:52.809810 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1866b5d-c7d2-48e2-9b56-82e77fb0a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:52.810610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1866b5d-c7d2-48e2-9b56-82e77fb0a137 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:52.810881 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1866b5d-c7d2-48e2-9b56-82e77fb0a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:52.811154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1866b5d-c7d2-48e2-9b56-82e77fb0a137 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:52.827108 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1866b5d-c7d2-48e2-9b56-82e77fb0a137 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:52.833992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b1866b5d-c7d2-48e2-9b56-82e77fb0a137 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:52.835239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 273/543] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:52.841039 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2694-318f-405e-8a46-f2e0fcd854f4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:52.850935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d2694-318f-405e-8a46-f2e0fcd854f4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:52.858297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78562228-b64e-4222-9d8e-38f7cb655327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:52.858964 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78562228-b64e-4222-9d8e-38f7cb655327 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:52.859244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78562228-b64e-4222-9d8e-38f7cb655327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:52.859519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78562228-b64e-4222-9d8e-38f7cb655327 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:52.860289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78562228-b64e-4222-9d8e-38f7cb655327 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:52.860627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78562228-b64e-4222-9d8e-38f7cb655327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:52.862249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78562228-b64e-4222-9d8e-38f7cb655327 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:52.875694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 271/544] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:52.881100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1866b5d-c7d2-48e2-9b56-82e77fb0a137 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:52.897319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1866b5d-c7d2-48e2-9b56-82e77fb0a137 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:52.903628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fad7b-51d6-4a83-9939-130059163d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:52.904428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fad7b-51d6-4a83-9939-130059163d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:52.904712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fad7b-51d6-4a83-9939-130059163d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:52.904983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fad7b-51d6-4a83-9939-130059163d6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:52.916782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fad7b-51d6-4a83-9939-130059163d6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:52.918640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fad7b-51d6-4a83-9939-130059163d6a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:52.944269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-ae0fad7b-51d6-4a83-9939-130059163d6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:52.945813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 274/545] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:52.951279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78562228-b64e-4222-9d8e-38f7cb655327 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:52.957209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad52d96-1bfe-4dd1-9500-e5f207e704da None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:52.957209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad52d96-1bfe-4dd1-9500-e5f207e704da None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:52.957209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad52d96-1bfe-4dd1-9500-e5f207e704da None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:52.957944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 275/546] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:52.964639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295aaa7-b110-4b16-baa1-14cee70d3be0 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:52.965197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295aaa7-b110-4b16-baa1-14cee70d3be0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:52.965672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295aaa7-b110-4b16-baa1-14cee70d3be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:52.970680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78562228-b64e-4222-9d8e-38f7cb655327 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:52.983915 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456ba39-41ae-445c-aaa1-bc711f2557d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:52.984627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456ba39-41ae-445c-aaa1-bc711f2557d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:52.984913 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456ba39-41ae-445c-aaa1-bc711f2557d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:52.985192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456ba39-41ae-445c-aaa1-bc711f2557d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:52.986044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456ba39-41ae-445c-aaa1-bc711f2557d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:52.986353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456ba39-41ae-445c-aaa1-bc711f2557d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:52.986962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6295aaa7-b110-4b16-baa1-14cee70d3be0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:52.987952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456ba39-41ae-445c-aaa1-bc711f2557d7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:52.988614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6295aaa7-b110-4b16-baa1-14cee70d3be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:53.003532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 276/547] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:53.012485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 272/548] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.017299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295aaa7-b110-4b16-baa1-14cee70d3be0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.027089 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295aaa7-b110-4b16-baa1-14cee70d3be0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.036438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43a5e-8641-4793-bca8-cf38c681750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.038078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43a5e-8641-4793-bca8-cf38c681750c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.038979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43a5e-8641-4793-bca8-cf38c681750c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.039455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43a5e-8641-4793-bca8-cf38c681750c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.052152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c43a5e-8641-4793-bca8-cf38c681750c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.055904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c43a5e-8641-4793-bca8-cf38c681750c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.077426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-32c43a5e-8641-4793-bca8-cf38c681750c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 02:28:53.079599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 277/549] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:53.085701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456ba39-41ae-445c-aaa1-bc711f2557d7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.096380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43a5e-8641-4793-bca8-cf38c681750c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.097337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456ba39-41ae-445c-aaa1-bc711f2557d7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.109950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c087037-d3f3-48e7-b1b9-81bc6afac75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.110993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c087037-d3f3-48e7-b1b9-81bc6afac75d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.111479 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c087037-d3f3-48e7-b1b9-81bc6afac75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.111967 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c087037-d3f3-48e7-b1b9-81bc6afac75d admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.114412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c087037-d3f3-48e7-b1b9-81bc6afac75d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.114943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c087037-d3f3-48e7-b1b9-81bc6afac75d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.119170 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43a5e-8641-4793-bca8-cf38c681750c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.121188 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c087037-d3f3-48e7-b1b9-81bc6afac75d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.134314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8413aac-ef9c-43b1-adbe-f2383feafbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.135531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8413aac-ef9c-43b1-adbe-f2383feafbea admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.136020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8413aac-ef9c-43b1-adbe-f2383feafbea admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.137357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8413aac-ef9c-43b1-adbe-f2383feafbea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.164761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8413aac-ef9c-43b1-adbe-f2383feafbea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:53.166111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 273/550] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.171818 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c087037-d3f3-48e7-b1b9-81bc6afac75d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.174566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-d8413aac-ef9c-43b1-adbe-f2383feafbea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:53.176282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 278/551] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.183046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8413aac-ef9c-43b1-adbe-f2383feafbea admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.188327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c087037-d3f3-48e7-b1b9-81bc6afac75d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.199420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8413aac-ef9c-43b1-adbe-f2383feafbea admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.203693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c970cc9-fef5-4ffc-b518-c214c715f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.204675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c970cc9-fef5-4ffc-b518-c214c715f943 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.205116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c970cc9-fef5-4ffc-b518-c214c715f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.205533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c970cc9-fef5-4ffc-b518-c214c715f943 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.216412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960d532-ec24-4470-80ff-a1056ecc781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.217284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960d532-ec24-4470-80ff-a1056ecc781f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.217726 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960d532-ec24-4470-80ff-a1056ecc781f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.218143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960d532-ec24-4470-80ff-a1056ecc781f admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.219044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960d532-ec24-4470-80ff-a1056ecc781f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.219492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960d532-ec24-4470-80ff-a1056ecc781f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.221278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960d532-ec24-4470-80ff-a1056ecc781f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.228098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c970cc9-fef5-4ffc-b518-c214c715f943 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.230157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c970cc9-fef5-4ffc-b518-c214c715f943 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.234562 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 279/552] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.235687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe0277-4c6f-48af-9fe0-579487c258e4 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.235968 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe0277-4c6f-48af-9fe0-579487c258e4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.236241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe0277-4c6f-48af-9fe0-579487c258e4 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.242256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 280/553] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:53.242949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe0277-4c6f-48af-9fe0-579487c258e4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.249961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2c970cc9-fef5-4ffc-b518-c214c715f943 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:53.251329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 274/554] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.252680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ac74-b367-4291-82ba-bc69436ccbcf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.253124 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ac74-b367-4291-82ba-bc69436ccbcf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.253533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ac74-b367-4291-82ba-bc69436ccbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.263117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe0277-4c6f-48af-9fe0-579487c258e4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.267590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aecc7e-90b6-4ac4-8ddb-a12feaf4539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.268388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aecc7e-90b6-4ac4-8ddb-a12feaf4539f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.268670 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aecc7e-90b6-4ac4-8ddb-a12feaf4539f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.268933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aecc7e-90b6-4ac4-8ddb-a12feaf4539f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.273056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-01d1ac74-b367-4291-82ba-bc69436ccbcf None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:53.274424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-01d1ac74-b367-4291-82ba-bc69436ccbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:53.280372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aecc7e-90b6-4ac4-8ddb-a12feaf4539f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.282345 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aecc7e-90b6-4ac4-8ddb-a12feaf4539f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.283183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 275/555] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:53.284266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ac74-b367-4291-82ba-bc69436ccbcf None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.294983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ac74-b367-4291-82ba-bc69436ccbcf None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.302012 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d15880-de9b-4677-ad96-522e76dd9f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.303966 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d15880-de9b-4677-ad96-522e76dd9f3d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.304719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d15880-de9b-4677-ad96-522e76dd9f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.305266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d15880-de9b-4677-ad96-522e76dd9f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.308131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d15880-de9b-4677-ad96-522e76dd9f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.308674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d15880-de9b-4677-ad96-522e76dd9f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.310623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d15880-de9b-4677-ad96-522e76dd9f3d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.315066 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b8aecc7e-90b6-4ac4-8ddb-a12feaf4539f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:53.316320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 281/556] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.317126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aecc7e-90b6-4ac4-8ddb-a12feaf4539f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.326052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 276/557] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.327292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d15880-de9b-4677-ad96-522e76dd9f3d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.336931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aecc7e-90b6-4ac4-8ddb-a12feaf4539f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.338805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d15880-de9b-4677-ad96-522e76dd9f3d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.341600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23337887-74a2-4367-9d9c-13921c5b796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.342480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23337887-74a2-4367-9d9c-13921c5b796b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.342755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23337887-74a2-4367-9d9c-13921c5b796b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.343025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23337887-74a2-4367-9d9c-13921c5b796b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.344785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a49280-366c-4903-806d-df8983fe823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.345691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a49280-366c-4903-806d-df8983fe823a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.346220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a49280-366c-4903-806d-df8983fe823a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.346708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a49280-366c-4903-806d-df8983fe823a admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.347725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a49280-366c-4903-806d-df8983fe823a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.348296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a49280-366c-4903-806d-df8983fe823a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.350783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a49280-366c-4903-806d-df8983fe823a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.354115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23337887-74a2-4367-9d9c-13921c5b796b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:53.360900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-23337887-74a2-4367-9d9c-13921c5b796b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:53.364158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 277/559] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.365283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a49280-366c-4903-806d-df8983fe823a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.366904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 282/559] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.367885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23337887-74a2-4367-9d9c-13921c5b796b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.376493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a49280-366c-4903-806d-df8983fe823a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.377893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23337887-74a2-4367-9d9c-13921c5b796b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.381803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c7086-a660-421c-91e8-3b5a23adb77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.382812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246685c0-0733-44ba-a776-a1ea1638e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.383114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c7086-a660-421c-91e8-3b5a23adb77d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.383446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246685c0-0733-44ba-a776-a1ea1638e17c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.383721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246685c0-0733-44ba-a776-a1ea1638e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.383991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246685c0-0733-44ba-a776-a1ea1638e17c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.384247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c7086-a660-421c-91e8-3b5a23adb77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.384758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c7086-a660-421c-91e8-3b5a23adb77d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.384857 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246685c0-0733-44ba-a776-a1ea1638e17c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.385048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246685c0-0733-44ba-a776-a1ea1638e17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.386823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246685c0-0733-44ba-a776-a1ea1638e17c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.393218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c7086-a660-421c-91e8-3b5a23adb77d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.395487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c7086-a660-421c-91e8-3b5a23adb77d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.400016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 283/560] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:53.400981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246685c0-0733-44ba-a776-a1ea1638e17c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.410450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246685c0-0733-44ba-a776-a1ea1638e17c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.415599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371725f5-46d4-4eab-af1e-ddaa81467687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.415845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7e2c7086-a660-421c-91e8-3b5a23adb77d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:53.416378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371725f5-46d4-4eab-af1e-ddaa81467687 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.416730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371725f5-46d4-4eab-af1e-ddaa81467687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.416996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371725f5-46d4-4eab-af1e-ddaa81467687 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.418140 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 278/561] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.419132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c7086-a660-421c-91e8-3b5a23adb77d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.429010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371725f5-46d4-4eab-af1e-ddaa81467687 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.430212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c7086-a660-421c-91e8-3b5a23adb77d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.431027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371725f5-46d4-4eab-af1e-ddaa81467687 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.434762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e4da-0d9b-479e-b84a-30e0305d1f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.435520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e4da-0d9b-479e-b84a-30e0305d1f57 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.435803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e4da-0d9b-479e-b84a-30e0305d1f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.436079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e4da-0d9b-479e-b84a-30e0305d1f57 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.446469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e4da-0d9b-479e-b84a-30e0305d1f57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.446862 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-371725f5-46d4-4eab-af1e-ddaa81467687 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 07 02:28:53.448285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 284/562] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.448417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e4da-0d9b-479e-b84a-30e0305d1f57 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.453174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371725f5-46d4-4eab-af1e-ddaa81467687 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.460986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371725f5-46d4-4eab-af1e-ddaa81467687 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.465354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb64e9-4232-4739-9d9e-94801f0f719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.465970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb64e9-4232-4739-9d9e-94801f0f719d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.466245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb64e9-4232-4739-9d9e-94801f0f719d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.466517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb64e9-4232-4739-9d9e-94801f0f719d admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.466620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c696e4da-0d9b-479e-b84a-30e0305d1f57 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:53.467297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb64e9-4232-4739-9d9e-94801f0f719d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.467600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb64e9-4232-4739-9d9e-94801f0f719d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.467983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 279/563] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.469155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4c17f-8ee1-46c1-9673-ca875a100d0b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.469441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4c17f-8ee1-46c1-9673-ca875a100d0b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.469717 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4c17f-8ee1-46c1-9673-ca875a100d0b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.471490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 280/564] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:53.473807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb64e9-4232-4739-9d9e-94801f0f719d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.476500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4c17f-8ee1-46c1-9673-ca875a100d0b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.491426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 285/565] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.491426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb64e9-4232-4739-9d9e-94801f0f719d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.492922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4c17f-8ee1-46c1-9673-ca875a100d0b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.496843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb64e9-4232-4739-9d9e-94801f0f719d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.497397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89136f-bb8f-4803-8121-76727fb35bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.498009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89136f-bb8f-4803-8121-76727fb35bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.498287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89136f-bb8f-4803-8121-76727fb35bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.498593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89136f-bb8f-4803-8121-76727fb35bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.499385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89136f-bb8f-4803-8121-76727fb35bf7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.499691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89136f-bb8f-4803-8121-76727fb35bf7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.501326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef2bbd-c698-4832-9639-9b2d44c319a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.501539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89136f-bb8f-4803-8121-76727fb35bf7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.501943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2bbd-c698-4832-9639-9b2d44c319a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.502215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2bbd-c698-4832-9639-9b2d44c319a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.502483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef2bbd-c698-4832-9639-9b2d44c319a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.503208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2bbd-c698-4832-9639-9b2d44c319a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.503481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2bbd-c698-4832-9639-9b2d44c319a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.505092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef2bbd-c698-4832-9639-9b2d44c319a0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.521006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 286/566] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.521006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436e532-429c-40d2-8ce6-47db7bd49351 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.521006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436e532-429c-40d2-8ce6-47db7bd49351 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.521006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436e532-429c-40d2-8ce6-47db7bd49351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.524445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 281/567] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.525103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89136f-bb8f-4803-8121-76727fb35bf7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.536688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89136f-bb8f-4803-8121-76727fb35bf7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.541428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d436e532-429c-40d2-8ce6-47db7bd49351 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:53.541608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650070cf-14ff-446a-8dce-876eb06e983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.542453 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650070cf-14ff-446a-8dce-876eb06e983a admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.542613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d436e532-429c-40d2-8ce6-47db7bd49351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:53.542764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650070cf-14ff-446a-8dce-876eb06e983a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.543007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650070cf-14ff-446a-8dce-876eb06e983a admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/904a4e5f54e642eda58c90930b5858f4/roles/252e58e0307c43339c5bc8a0d299fea2` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.550226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 287/568] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:53.550829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436e532-429c-40d2-8ce6-47db7bd49351 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.561833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436e532-429c-40d2-8ce6-47db7bd49351 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.569430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650070cf-14ff-446a-8dce-876eb06e983a admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=904a4e5f54e642eda58c90930b5858f4, role_id=252e58e0307c43339c5bc8a0d299fea2)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.572042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650070cf-14ff-446a-8dce-876eb06e983a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.573962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96e58b-5d9f-40bd-81fd-1cd11631b1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.574755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96e58b-5d9f-40bd-81fd-1cd11631b1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.575034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96e58b-5d9f-40bd-81fd-1cd11631b1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.575305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96e58b-5d9f-40bd-81fd-1cd11631b1e4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.583313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96e58b-5d9f-40bd-81fd-1cd11631b1e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.586094 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96e58b-5d9f-40bd-81fd-1cd11631b1e4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.587335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 282/569] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:53 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/904a4e5f54e642eda58c90930b5858f4/roles/252e58e0307c43339c5bc8a0d299fea2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:53.597397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650070cf-14ff-446a-8dce-876eb06e983a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.601232 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-8c96e58b-5d9f-40bd-81fd-1cd11631b1e4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 07 02:28:53.607124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 288/570] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.607124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96e58b-5d9f-40bd-81fd-1cd11631b1e4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.617561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96e58b-5d9f-40bd-81fd-1cd11631b1e4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.677517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650070cf-14ff-446a-8dce-876eb06e983a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.682290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855bd2e-8267-405e-8c0e-df03845da496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.682819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354deff-3cec-4d51-bd09-5142b87e13a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.683106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bd2e-8267-405e-8c0e-df03845da496 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.683388 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bd2e-8267-405e-8c0e-df03845da496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.683611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354deff-3cec-4d51-bd09-5142b87e13a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.683709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855bd2e-8267-405e-8c0e-df03845da496 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.683889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354deff-3cec-4d51-bd09-5142b87e13a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.684159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354deff-3cec-4d51-bd09-5142b87e13a2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.695870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855bd2e-8267-405e-8c0e-df03845da496 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.697546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354deff-3cec-4d51-bd09-5142b87e13a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:53.697783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855bd2e-8267-405e-8c0e-df03845da496 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.704953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5354deff-3cec-4d51-bd09-5142b87e13a2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:53.711590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 289/571] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.711590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6a58d-5027-46d1-a82f-94a0b755f24d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.711590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6a58d-5027-46d1-a82f-94a0b755f24d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.711590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6a58d-5027-46d1-a82f-94a0b755f24d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.711590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 290/572] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:53.712208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6a58d-5027-46d1-a82f-94a0b755f24d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.722665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c855bd2e-8267-405e-8c0e-df03845da496 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:53.729113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 283/573] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.729113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855bd2e-8267-405e-8c0e-df03845da496 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.730787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6a58d-5027-46d1-a82f-94a0b755f24d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.735413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.736085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.736539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.736817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.737754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.738139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.738914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855bd2e-8267-405e-8c0e-df03845da496 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.739318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:53.739318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:28:53.739318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:28:53.740612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.745560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ad1ac-f56b-4826-aed7-3500ae0c737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.746237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ad1ac-f56b-4826-aed7-3500ae0c737c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.746517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ad1ac-f56b-4826-aed7-3500ae0c737c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.746788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ad1ac-f56b-4826-aed7-3500ae0c737c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.747545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ad1ac-f56b-4826-aed7-3500ae0c737c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.747873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ad1ac-f56b-4826-aed7-3500ae0c737c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.749499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ad1ac-f56b-4826-aed7-3500ae0c737c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.760097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 284/574] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.761629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3222bc-c39f-4667-845a-446090cb90d9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.762059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3222bc-c39f-4667-845a-446090cb90d9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.762490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3222bc-c39f-4667-845a-446090cb90d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.780567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2c3222bc-c39f-4667-845a-446090cb90d9 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:53.781770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2c3222bc-c39f-4667-845a-446090cb90d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:53.783202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 291/575] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.784115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.790715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 285/576] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:53.791358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3222bc-c39f-4667-845a-446090cb90d9 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.799730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8447d-e74a-416f-9e49-6792d67b045c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.800595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3222bc-c39f-4667-845a-446090cb90d9 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.805687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab46060-38c8-4d05-80b1-bed805e03053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.806238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d2ee-4623-4775-8e28-f5ef91213caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.806681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab46060-38c8-4d05-80b1-bed805e03053 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.807060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d2ee-4623-4775-8e28-f5ef91213caf admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.807256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab46060-38c8-4d05-80b1-bed805e03053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.807372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d2ee-4623-4775-8e28-f5ef91213caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.807591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d2ee-4623-4775-8e28-f5ef91213caf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.807911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab46060-38c8-4d05-80b1-bed805e03053 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.808821 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab46060-38c8-4d05-80b1-bed805e03053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.809258 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab46060-38c8-4d05-80b1-bed805e03053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.811564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab46060-38c8-4d05-80b1-bed805e03053 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.818555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736d2ee-4623-4775-8e28-f5ef91213caf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.820420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736d2ee-4623-4775-8e28-f5ef91213caf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.825345 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 292/577] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.826553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab46060-38c8-4d05-80b1-bed805e03053 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.837195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab46060-38c8-4d05-80b1-bed805e03053 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.837463 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6736d2ee-4623-4775-8e28-f5ef91213caf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:53.838650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 286/578] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.839410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d2ee-4623-4775-8e28-f5ef91213caf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.842458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b75131-a7d9-4a4c-838d-7b18214bc413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.843399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b75131-a7d9-4a4c-838d-7b18214bc413 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.843814 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b75131-a7d9-4a4c-838d-7b18214bc413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.844441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b75131-a7d9-4a4c-838d-7b18214bc413 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.848772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d2ee-4623-4775-8e28-f5ef91213caf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.853882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98877d9f-1797-43ed-8955-5ccee1a3d1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.854441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98877d9f-1797-43ed-8955-5ccee1a3d1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.854720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98877d9f-1797-43ed-8955-5ccee1a3d1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.854990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98877d9f-1797-43ed-8955-5ccee1a3d1b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.858332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b75131-a7d9-4a4c-838d-7b18214bc413 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.860638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b75131-a7d9-4a4c-838d-7b18214bc413 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.865209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98877d9f-1797-43ed-8955-5ccee1a3d1b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:53.872605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-98877d9f-1797-43ed-8955-5ccee1a3d1b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:53.873771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 287/579] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.874524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98877d9f-1797-43ed-8955-5ccee1a3d1b7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.879036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-13b75131-a7d9-4a4c-838d-7b18214bc413 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:53.881152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 293/580] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.882058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b75131-a7d9-4a4c-838d-7b18214bc413 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.884559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98877d9f-1797-43ed-8955-5ccee1a3d1b7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.889300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27188-1a3e-46bf-8aa7-e345ee359c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.889964 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27188-1a3e-46bf-8aa7-e345ee359c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.890241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27188-1a3e-46bf-8aa7-e345ee359c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.890507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27188-1a3e-46bf-8aa7-e345ee359c40 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.893144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b75131-a7d9-4a4c-838d-7b18214bc413 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.897992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde27188-1a3e-46bf-8aa7-e345ee359c40 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.900146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde27188-1a3e-46bf-8aa7-e345ee359c40 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.901405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60893a9c-ef85-4966-ba07-b04b3226b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.902061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60893a9c-ef85-4966-ba07-b04b3226b3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.902338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60893a9c-ef85-4966-ba07-b04b3226b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.902625 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60893a9c-ef85-4966-ba07-b04b3226b3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.903528 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60893a9c-ef85-4966-ba07-b04b3226b3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.904079 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60893a9c-ef85-4966-ba07-b04b3226b3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.906051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60893a9c-ef85-4966-ba07-b04b3226b3b9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.917454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-fde27188-1a3e-46bf-8aa7-e345ee359c40 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:53.924769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 288/581] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:53.924769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27188-1a3e-46bf-8aa7-e345ee359c40 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.925032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 294/582] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.925032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60893a9c-ef85-4966-ba07-b04b3226b3b9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.934728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60893a9c-ef85-4966-ba07-b04b3226b3b9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.936609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27188-1a3e-46bf-8aa7-e345ee359c40 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.939274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6d9af-b7b0-4715-92d9-b41fe3b47625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.939995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6d9af-b7b0-4715-92d9-b41fe3b47625 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.940337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6d9af-b7b0-4715-92d9-b41fe3b47625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.940728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6d9af-b7b0-4715-92d9-b41fe3b47625 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.941104 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13daddb8-3996-4433-8c23-d4cfb8209e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.941576 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6d9af-b7b0-4715-92d9-b41fe3b47625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.941919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13daddb8-3996-4433-8c23-d4cfb8209e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.942011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6d9af-b7b0-4715-92d9-b41fe3b47625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.942311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13daddb8-3996-4433-8c23-d4cfb8209e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.942659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13daddb8-3996-4433-8c23-d4cfb8209e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.943481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13daddb8-3996-4433-8c23-d4cfb8209e24 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.943861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf6d9af-b7b0-4715-92d9-b41fe3b47625 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.943950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13daddb8-3996-4433-8c23-d4cfb8209e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.945574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13daddb8-3996-4433-8c23-d4cfb8209e24 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.959062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 289/583] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.959206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 295/584] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.959283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13daddb8-3996-4433-8c23-d4cfb8209e24 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.959352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6d9af-b7b0-4715-92d9-b41fe3b47625 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.968910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13daddb8-3996-4433-8c23-d4cfb8209e24 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.972732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6d9af-b7b0-4715-92d9-b41fe3b47625 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:53.973300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb251f1-a2a8-4434-a707-372137731830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.974134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb251f1-a2a8-4434-a707-372137731830 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.974479 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb251f1-a2a8-4434-a707-372137731830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.974816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb251f1-a2a8-4434-a707-372137731830 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.978017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dfc5e-8b84-4df0-af47-42a61acd1150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:53.978651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfc5e-8b84-4df0-af47-42a61acd1150 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:53.978924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfc5e-8b84-4df0-af47-42a61acd1150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:53.979193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfc5e-8b84-4df0-af47-42a61acd1150 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:53.979974 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dfc5e-8b84-4df0-af47-42a61acd1150 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:53.980275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dfc5e-8b84-4df0-af47-42a61acd1150 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.982136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dfc5e-8b84-4df0-af47-42a61acd1150 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.983566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb251f1-a2a8-4434-a707-372137731830 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:53.985719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb251f1-a2a8-4434-a707-372137731830 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:53.998898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 296/585] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:53.998898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dfc5e-8b84-4df0-af47-42a61acd1150 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:53.999710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7eb251f1-a2a8-4434-a707-372137731830 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 07 02:28:54.001073 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 290/586] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:54.005413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb251f1-a2a8-4434-a707-372137731830 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.008431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dfc5e-8b84-4df0-af47-42a61acd1150 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.012858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56c2f-7f85-4d23-851a-5a4bc8cbf5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.013687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56c2f-7f85-4d23-851a-5a4bc8cbf5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.014036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56c2f-7f85-4d23-851a-5a4bc8cbf5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.014374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a56c2f-7f85-4d23-851a-5a4bc8cbf5e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.014806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb251f1-a2a8-4434-a707-372137731830 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.019078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c909-e1d7-42dd-8d68-d81f30cadb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.019866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c909-e1d7-42dd-8d68-d81f30cadb80 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.020214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c909-e1d7-42dd-8d68-d81f30cadb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.020591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c909-e1d7-42dd-8d68-d81f30cadb80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.021440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56c2f-7f85-4d23-851a-5a4bc8cbf5e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.024025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a56c2f-7f85-4d23-851a-5a4bc8cbf5e8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.031215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c909-e1d7-42dd-8d68-d81f30cadb80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.033098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c909-e1d7-42dd-8d68-d81f30cadb80 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.037014 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-61a56c2f-7f85-4d23-851a-5a4bc8cbf5e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:54.038959 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 297/587] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:54.039517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56c2f-7f85-4d23-851a-5a4bc8cbf5e8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.049913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a56c2f-7f85-4d23-851a-5a4bc8cbf5e8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.054225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720c381-4f6e-4d87-bc4f-1f9f4977d809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.055015 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-dce3c909-e1d7-42dd-8d68-d81f30cadb80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:54.055140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720c381-4f6e-4d87-bc4f-1f9f4977d809 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.055312 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720c381-4f6e-4d87-bc4f-1f9f4977d809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.055584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720c381-4f6e-4d87-bc4f-1f9f4977d809 admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/612a02fb42af490abcba0e75ec8c759f/roles/252e58e0307c43339c5bc8a0d299fea2` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.056200 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 291/588] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:54.061205 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c909-e1d7-42dd-8d68-d81f30cadb80 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.069644 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720c381-4f6e-4d87-bc4f-1f9f4977d809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=612a02fb42af490abcba0e75ec8c759f, role_id=252e58e0307c43339c5bc8a0d299fea2)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.070811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c909-e1d7-42dd-8d68-d81f30cadb80 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.072241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720c381-4f6e-4d87-bc4f-1f9f4977d809 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.075418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1907be-cd24-46b5-8b8f-590af836540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.076512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1907be-cd24-46b5-8b8f-590af836540c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.076791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1907be-cd24-46b5-8b8f-590af836540c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.077064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1907be-cd24-46b5-8b8f-590af836540c admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.077899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1907be-cd24-46b5-8b8f-590af836540c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:54.078200 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1907be-cd24-46b5-8b8f-590af836540c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.079992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1907be-cd24-46b5-8b8f-590af836540c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.085784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 298/589] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:54 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/612a02fb42af490abcba0e75ec8c759f/roles/252e58e0307c43339c5bc8a0d299fea2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:54.086716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720c381-4f6e-4d87-bc4f-1f9f4977d809 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.110735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 292/590] 10.222.0.15 () {56 vars in 1160 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:54.111748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1907be-cd24-46b5-8b8f-590af836540c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.121938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1907be-cd24-46b5-8b8f-590af836540c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.165582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720c381-4f6e-4d87-bc4f-1f9f4977d809 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.170583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141163-b0eb-411d-b4ba-0ecd9263828d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.171476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141163-b0eb-411d-b4ba-0ecd9263828d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.171900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141163-b0eb-411d-b4ba-0ecd9263828d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.172318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141163-b0eb-411d-b4ba-0ecd9263828d admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.173325 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141163-b0eb-411d-b4ba-0ecd9263828d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:54.173777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141163-b0eb-411d-b4ba-0ecd9263828d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.175856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141163-b0eb-411d-b4ba-0ecd9263828d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.182889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a582b9c-acbf-4b49-b299-0aeb10b6ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.184454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582b9c-acbf-4b49-b299-0aeb10b6ce65 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.184454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582b9c-acbf-4b49-b299-0aeb10b6ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.184454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a582b9c-acbf-4b49-b299-0aeb10b6ce65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.185296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a582b9c-acbf-4b49-b299-0aeb10b6ce65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:54.185715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a582b9c-acbf-4b49-b299-0aeb10b6ce65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.187637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a582b9c-acbf-4b49-b299-0aeb10b6ce65 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.193243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 299/591] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:54.194470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141163-b0eb-411d-b4ba-0ecd9263828d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.210490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 293/592] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:54.211738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a582b9c-acbf-4b49-b299-0aeb10b6ce65 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.213276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141163-b0eb-411d-b4ba-0ecd9263828d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.224121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e05c-2b03-4369-b0d2-9f9e9b97ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.225052 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e05c-2b03-4369-b0d2-9f9e9b97ff29 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.226230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e05c-2b03-4369-b0d2-9f9e9b97ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.226504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e05c-2b03-4369-b0d2-9f9e9b97ff29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.230572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a582b9c-acbf-4b49-b299-0aeb10b6ce65 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.235328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b693d72-779b-47fd-ae9e-267ea3596afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.236225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693d72-779b-47fd-ae9e-267ea3596afd admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.236542 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693d72-779b-47fd-ae9e-267ea3596afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.236811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693d72-779b-47fd-ae9e-267ea3596afd admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/2e738156764e4b038adc89cf114ccda3/roles/252e58e0307c43339c5bc8a0d299fea2` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.242949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796e05c-2b03-4369-b0d2-9f9e9b97ff29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.246153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796e05c-2b03-4369-b0d2-9f9e9b97ff29 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.254085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b693d72-779b-47fd-ae9e-267ea3596afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=2e738156764e4b038adc89cf114ccda3, role_id=252e58e0307c43339c5bc8a0d299fea2)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.256854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b693d72-779b-47fd-ae9e-267ea3596afd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.268898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a796e05c-2b03-4369-b0d2-9f9e9b97ff29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:54.270374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 300/593] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:54.271155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e05c-2b03-4369-b0d2-9f9e9b97ff29 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.277711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 294/594] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:54 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/2e738156764e4b038adc89cf114ccda3/roles/252e58e0307c43339c5bc8a0d299fea2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:28:54.278390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b693d72-779b-47fd-ae9e-267ea3596afd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.291158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e05c-2b03-4369-b0d2-9f9e9b97ff29 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.354247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbcc15-0c5a-4b4d-b13d-3d7371ea1ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.355487 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbcc15-0c5a-4b4d-b13d-3d7371ea1ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.355969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbcc15-0c5a-4b4d-b13d-3d7371ea1ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.356479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbcc15-0c5a-4b4d-b13d-3d7371ea1ad0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.358277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b693d72-779b-47fd-ae9e-267ea3596afd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.363691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b90c3-5f8f-4dbb-9f18-d5d9d065eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.364803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b90c3-5f8f-4dbb-9f18-d5d9d065eb5b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.365603 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b90c3-5f8f-4dbb-9f18-d5d9d065eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.366168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b90c3-5f8f-4dbb-9f18-d5d9d065eb5b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.366660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbcc15-0c5a-4b4d-b13d-3d7371ea1ad0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.367519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b90c3-5f8f-4dbb-9f18-d5d9d065eb5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:54.368050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b90c3-5f8f-4dbb-9f18-d5d9d065eb5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.369524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbcc15-0c5a-4b4d-b13d-3d7371ea1ad0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.369952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b90c3-5f8f-4dbb-9f18-d5d9d065eb5b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.384781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 295/595] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:54.390122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b90c3-5f8f-4dbb-9f18-d5d9d065eb5b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.390706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-62fbcc15-0c5a-4b4d-b13d-3d7371ea1ad0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 02:28:54.392528 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 301/596] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:54.402497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b90c3-5f8f-4dbb-9f18-d5d9d065eb5b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.403786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbcc15-0c5a-4b4d-b13d-3d7371ea1ad0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.406233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1348b-3fb6-4a80-87ab-194b71cec5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.407245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1348b-3fb6-4a80-87ab-194b71cec5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.407598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1348b-3fb6-4a80-87ab-194b71cec5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.407989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1348b-3fb6-4a80-87ab-194b71cec5fd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.416718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbcc15-0c5a-4b4d-b13d-3d7371ea1ad0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.417309 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1348b-3fb6-4a80-87ab-194b71cec5fd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.419359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1348b-3fb6-4a80-87ab-194b71cec5fd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.422279 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410c264-ee5b-4aa5-840c-9007177c5409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.423230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410c264-ee5b-4aa5-840c-9007177c5409 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.423741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410c264-ee5b-4aa5-840c-9007177c5409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.424248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410c264-ee5b-4aa5-840c-9007177c5409 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.425522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410c264-ee5b-4aa5-840c-9007177c5409 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:54.426039 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410c264-ee5b-4aa5-840c-9007177c5409 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.428328 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410c264-ee5b-4aa5-840c-9007177c5409 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.436638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-fff1348b-3fb6-4a80-87ab-194b71cec5fd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:54.437906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 296/597] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:54.443549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1348b-3fb6-4a80-87ab-194b71cec5fd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.453500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 302/598] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:54.458286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1348b-3fb6-4a80-87ab-194b71cec5fd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.459468 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.460472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410c264-ee5b-4aa5-840c-9007177c5409 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.460745 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.460971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.461244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.462124 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:54.462454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.463467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:28:54.463467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:28:54.463467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:28:54.464639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.472788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410c264-ee5b-4aa5-840c-9007177c5409 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.478538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd4a0-7b6c-46c4-97a8-47a488be2f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.479500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd4a0-7b6c-46c4-97a8-47a488be2f7f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.479976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd4a0-7b6c-46c4-97a8-47a488be2f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.480511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bd4a0-7b6c-46c4-97a8-47a488be2f7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.485604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 297/599] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:54.489925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bd4a0-7b6c-46c4-97a8-47a488be2f7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.491313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.492547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bd4a0-7b6c-46c4-97a8-47a488be2f7f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.501098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb634ee-35ce-4780-a813-27886ad44c79 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.503119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 303/600] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:54.508674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd4a0-7b6c-46c4-97a8-47a488be2f7f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.513410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268d2f3-ac9a-4a3b-84c7-d0861ab0b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.514591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d2f3-ac9a-4a3b-84c7-d0861ab0b1da admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.515112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d2f3-ac9a-4a3b-84c7-d0861ab0b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.515920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268d2f3-ac9a-4a3b-84c7-d0861ab0b1da admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/b3922641f7c846da98457824bec58652/roles/252e58e0307c43339c5bc8a0d299fea2` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.523324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bd4a0-7b6c-46c4-97a8-47a488be2f7f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.533968 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db737c-173e-4f37-bfb9-23429f108d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.535258 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db737c-173e-4f37-bfb9-23429f108d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.535879 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db737c-173e-4f37-bfb9-23429f108d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.536311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db737c-173e-4f37-bfb9-23429f108d4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.537345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268d2f3-ac9a-4a3b-84c7-d0861ab0b1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=b3922641f7c846da98457824bec58652, role_id=252e58e0307c43339c5bc8a0d299fea2)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.540204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268d2f3-ac9a-4a3b-84c7-d0861ab0b1da admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.549190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db737c-173e-4f37-bfb9-23429f108d4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.551661 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db737c-173e-4f37-bfb9-23429f108d4d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.558775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 298/601] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:54 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/b3922641f7c846da98457824bec58652/roles/252e58e0307c43339c5bc8a0d299fea2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:28:54.579590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-05db737c-173e-4f37-bfb9-23429f108d4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:54.581623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 304/602] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:54.587665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268d2f3-ac9a-4a3b-84c7-d0861ab0b1da admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.668163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268d2f3-ac9a-4a3b-84c7-d0861ab0b1da admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.675687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642bc64-a578-4cef-b2e9-1dbda8879930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.676605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642bc64-a578-4cef-b2e9-1dbda8879930 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.676986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642bc64-a578-4cef-b2e9-1dbda8879930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.677831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642bc64-a578-4cef-b2e9-1dbda8879930 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.680364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642bc64-a578-4cef-b2e9-1dbda8879930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:54.680364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642bc64-a578-4cef-b2e9-1dbda8879930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.681748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642bc64-a578-4cef-b2e9-1dbda8879930 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.698840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 299/603] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:54.704559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db737c-173e-4f37-bfb9-23429f108d4d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.714969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db737c-173e-4f37-bfb9-23429f108d4d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.723167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6f5cf-44eb-4443-9bfe-2ecebb7bb8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.724166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6f5cf-44eb-4443-9bfe-2ecebb7bb8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.724474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6f5cf-44eb-4443-9bfe-2ecebb7bb8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.724793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6f5cf-44eb-4443-9bfe-2ecebb7bb8e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.733987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6f5cf-44eb-4443-9bfe-2ecebb7bb8e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.736061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6f5cf-44eb-4443-9bfe-2ecebb7bb8e1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.750316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a7b6f5cf-44eb-4443-9bfe-2ecebb7bb8e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:54.751912 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 305/604] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:54.757999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642bc64-a578-4cef-b2e9-1dbda8879930 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.774577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642bc64-a578-4cef-b2e9-1dbda8879930 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.782700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e379-2d74-4fe6-8222-80758c123545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.783407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e379-2d74-4fe6-8222-80758c123545 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.783697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e379-2d74-4fe6-8222-80758c123545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.783969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e379-2d74-4fe6-8222-80758c123545 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.784899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e379-2d74-4fe6-8222-80758c123545 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:54.785213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e379-2d74-4fe6-8222-80758c123545 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.787153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e379-2d74-4fe6-8222-80758c123545 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.805381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 300/605] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:54.811335 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6f5cf-44eb-4443-9bfe-2ecebb7bb8e1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:54.823423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6f5cf-44eb-4443-9bfe-2ecebb7bb8e1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:54.832962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963880fd-405e-40bf-b2ca-6a07c4873491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:54.833696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963880fd-405e-40bf-b2ca-6a07c4873491 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:54.834033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963880fd-405e-40bf-b2ca-6a07c4873491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:54.834305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963880fd-405e-40bf-b2ca-6a07c4873491 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:54.835254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963880fd-405e-40bf-b2ca-6a07c4873491 admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=2074fd021729416ea1c9b596d0bb892b) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:54.835568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963880fd-405e-40bf-b2ca-6a07c4873491 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:54.837511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963880fd-405e-40bf-b2ca-6a07c4873491 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:54.844053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 306/606] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:54 2022] GET /identity/v3/role_assignments?user.id=2074fd021729416ea1c9b596d0bb892b&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:56.241170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5485e4a-67a7-47d4-b137-35747234025a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.241685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5485e4a-67a7-47d4-b137-35747234025a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.241968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5485e4a-67a7-47d4-b137-35747234025a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.244077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 301/607] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:56.249553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87badf6-b88e-4b06-9ef0-b1669afc003b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.249987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87badf6-b88e-4b06-9ef0-b1669afc003b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.250157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87badf6-b88e-4b06-9ef0-b1669afc003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.272825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f87badf6-b88e-4b06-9ef0-b1669afc003b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:56.274006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f87badf6-b88e-4b06-9ef0-b1669afc003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:56.286445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 307/608] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:56.310664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5485e4a-67a7-47d4-b137-35747234025a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.327124 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5485e4a-67a7-47d4-b137-35747234025a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.334965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79b48-3fd8-4ef6-a443-69ebb6027281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.335771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79b48-3fd8-4ef6-a443-69ebb6027281 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.336049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79b48-3fd8-4ef6-a443-69ebb6027281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.336322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad79b48-3fd8-4ef6-a443-69ebb6027281 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.351567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad79b48-3fd8-4ef6-a443-69ebb6027281 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:56.358624 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7ad79b48-3fd8-4ef6-a443-69ebb6027281 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:56.360057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 302/609] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:56.365994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87badf6-b88e-4b06-9ef0-b1669afc003b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.374999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87badf6-b88e-4b06-9ef0-b1669afc003b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.384541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e6441-cfed-44e5-ae4e-84fa52cb1c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.385198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e6441-cfed-44e5-ae4e-84fa52cb1c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.385471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e6441-cfed-44e5-ae4e-84fa52cb1c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.385741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e6441-cfed-44e5-ae4e-84fa52cb1c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.386493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e6441-cfed-44e5-ae4e-84fa52cb1c10 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:56.386793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e6441-cfed-44e5-ae4e-84fa52cb1c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.388396 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e6441-cfed-44e5-ae4e-84fa52cb1c10 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.400527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 308/610] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:56.405916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79b48-3fd8-4ef6-a443-69ebb6027281 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.421419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad79b48-3fd8-4ef6-a443-69ebb6027281 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.429481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0fd62-5024-40c1-ad35-0a9bbbcca57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.430265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0fd62-5024-40c1-ad35-0a9bbbcca57a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.430536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0fd62-5024-40c1-ad35-0a9bbbcca57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.430802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0fd62-5024-40c1-ad35-0a9bbbcca57a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.447475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0fd62-5024-40c1-ad35-0a9bbbcca57a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.449344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0fd62-5024-40c1-ad35-0a9bbbcca57a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.469987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-fdf0fd62-5024-40c1-ad35-0a9bbbcca57a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:56.471363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 303/611] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:56.477490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e6441-cfed-44e5-ae4e-84fa52cb1c10 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.490619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e6441-cfed-44e5-ae4e-84fa52cb1c10 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.495229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5843d3b-19dc-4d38-beab-a585419cfdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.495816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5843d3b-19dc-4d38-beab-a585419cfdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.496087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5843d3b-19dc-4d38-beab-a585419cfdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.496372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5843d3b-19dc-4d38-beab-a585419cfdf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.497146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5843d3b-19dc-4d38-beab-a585419cfdf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:56.497448 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5843d3b-19dc-4d38-beab-a585419cfdf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.499017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5843d3b-19dc-4d38-beab-a585419cfdf4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.515765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 309/612] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:56.521278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0fd62-5024-40c1-ad35-0a9bbbcca57a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.537277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0fd62-5024-40c1-ad35-0a9bbbcca57a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.546008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d469a-6d7e-4326-9c46-9d248ccc3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.546796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d469a-6d7e-4326-9c46-9d248ccc3017 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.547072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d469a-6d7e-4326-9c46-9d248ccc3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.547342 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d469a-6d7e-4326-9c46-9d248ccc3017 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.561903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d469a-6d7e-4326-9c46-9d248ccc3017 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.564005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d469a-6d7e-4326-9c46-9d248ccc3017 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.581729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-8f1d469a-6d7e-4326-9c46-9d248ccc3017 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 02:28:56.582320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 304/613] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:56.588656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5843d3b-19dc-4d38-beab-a585419cfdf4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.601275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5843d3b-19dc-4d38-beab-a585419cfdf4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.605958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ce13f-ef33-45b1-adbe-c679be2d3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.606858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ce13f-ef33-45b1-adbe-c679be2d3bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.607355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ce13f-ef33-45b1-adbe-c679be2d3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.607840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ce13f-ef33-45b1-adbe-c679be2d3bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.608907 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ce13f-ef33-45b1-adbe-c679be2d3bf6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:56.609419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ce13f-ef33-45b1-adbe-c679be2d3bf6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.611441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ce13f-ef33-45b1-adbe-c679be2d3bf6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.646133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 310/614] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:56.652424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d469a-6d7e-4326-9c46-9d248ccc3017 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.670670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d469a-6d7e-4326-9c46-9d248ccc3017 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.681223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae253-6ad4-4b18-b903-087d03852953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.682138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae253-6ad4-4b18-b903-087d03852953 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.682619 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae253-6ad4-4b18-b903-087d03852953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.683094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ae253-6ad4-4b18-b903-087d03852953 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.691943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ae253-6ad4-4b18-b903-087d03852953 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.694542 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ae253-6ad4-4b18-b903-087d03852953 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.704546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 305/615] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:56.710835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ce13f-ef33-45b1-adbe-c679be2d3bf6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.726182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ce13f-ef33-45b1-adbe-c679be2d3bf6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.740305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3a85b-7c19-48a8-9e4a-ff0534dd0353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.741160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3a85b-7c19-48a8-9e4a-ff0534dd0353 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.741443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3a85b-7c19-48a8-9e4a-ff0534dd0353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.741726 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3a85b-7c19-48a8-9e4a-ff0534dd0353 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.759377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3a85b-7c19-48a8-9e4a-ff0534dd0353 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.761162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3a85b-7c19-48a8-9e4a-ff0534dd0353 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.790507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-67c3a85b-7c19-48a8-9e4a-ff0534dd0353 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:56.791889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 311/616] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:56.797621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae253-6ad4-4b18-b903-087d03852953 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.814704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ae253-6ad4-4b18-b903-087d03852953 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.822313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b55c02-da94-49c5-af76-2836fc440408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.823351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b55c02-da94-49c5-af76-2836fc440408 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.823865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b55c02-da94-49c5-af76-2836fc440408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.828557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b55c02-da94-49c5-af76-2836fc440408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.829853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b55c02-da94-49c5-af76-2836fc440408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:56.830370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b55c02-da94-49c5-af76-2836fc440408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.832238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b55c02-da94-49c5-af76-2836fc440408 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.848461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 306/617] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:56.853800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3a85b-7c19-48a8-9e4a-ff0534dd0353 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.870710 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3a85b-7c19-48a8-9e4a-ff0534dd0353 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.878878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5686586-cf4a-47e8-9496-93b61232154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.879677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686586-cf4a-47e8-9496-93b61232154f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.879958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686586-cf4a-47e8-9496-93b61232154f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.880234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5686586-cf4a-47e8-9496-93b61232154f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.889314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5686586-cf4a-47e8-9496-93b61232154f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.891251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5686586-cf4a-47e8-9496-93b61232154f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.911493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b5686586-cf4a-47e8-9496-93b61232154f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:56.913058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 312/618] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:56.918355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5686586-cf4a-47e8-9496-93b61232154f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.919077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0c67-1b84-4035-adb9-1dee68ef403d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.919369 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0c67-1b84-4035-adb9-1dee68ef403d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.919654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0c67-1b84-4035-adb9-1dee68ef403d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.923446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 307/619] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:56.927774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae1f37-7577-4180-9f86-90ff82c68e70 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.928849 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae1f37-7577-4180-9f86-90ff82c68e70 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.929344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae1f37-7577-4180-9f86-90ff82c68e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.934321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5686586-cf4a-47e8-9496-93b61232154f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:56.945766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb5a2c-6478-4d1c-a9a6-ef52c1676c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:56.946758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb5a2c-6478-4d1c-a9a6-ef52c1676c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:56.947237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb5a2c-6478-4d1c-a9a6-ef52c1676c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:56.949103 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb5a2c-6478-4d1c-a9a6-ef52c1676c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:56.950112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb5a2c-6478-4d1c-a9a6-ef52c1676c57 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:56.950638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb5a2c-6478-4d1c-a9a6-ef52c1676c57 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:56.956088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb5a2c-6478-4d1c-a9a6-ef52c1676c57 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:56.958903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c8ae1f37-7577-4180-9f86-90ff82c68e70 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:56.961254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c8ae1f37-7577-4180-9f86-90ff82c68e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:56.976305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 313/620] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:56.984554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb5a2c-6478-4d1c-a9a6-ef52c1676c57 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:56.989649 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 308/621] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:56.999730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb5a2c-6478-4d1c-a9a6-ef52c1676c57 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.004447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0415-effa-4b20-8c04-c1126e303a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.005344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0415-effa-4b20-8c04-c1126e303a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.005847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0415-effa-4b20-8c04-c1126e303a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.006884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0415-effa-4b20-8c04-c1126e303a4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.008599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae1f37-7577-4180-9f86-90ff82c68e70 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.014533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0415-effa-4b20-8c04-c1126e303a4f admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=904a4e5f54e642eda58c90930b5858f4) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.016087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0415-effa-4b20-8c04-c1126e303a4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.018387 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0415-effa-4b20-8c04-c1126e303a4f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.020625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae1f37-7577-4180-9f86-90ff82c68e70 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.027305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099687ff-b0a7-48e9-a40b-8348e32b1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.028370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099687ff-b0a7-48e9-a40b-8348e32b1202 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.029872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099687ff-b0a7-48e9-a40b-8348e32b1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.031304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099687ff-b0a7-48e9-a40b-8348e32b1202 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.035513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 314/622] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:56 2022] GET /identity/v3/role_assignments?user.id=904a4e5f54e642eda58c90930b5858f4&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.073603 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099687ff-b0a7-48e9-a40b-8348e32b1202 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:57.080976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-099687ff-b0a7-48e9-a40b-8348e32b1202 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:57.082562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 309/623] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:57.088433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0415-effa-4b20-8c04-c1126e303a4f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.101739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0415-effa-4b20-8c04-c1126e303a4f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.106237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454292b7-c1d8-46d9-acf5-8391054e69da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.106904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454292b7-c1d8-46d9-acf5-8391054e69da admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.107186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454292b7-c1d8-46d9-acf5-8391054e69da admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.107460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454292b7-c1d8-46d9-acf5-8391054e69da admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.108218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454292b7-c1d8-46d9-acf5-8391054e69da admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.108561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454292b7-c1d8-46d9-acf5-8391054e69da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.110162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454292b7-c1d8-46d9-acf5-8391054e69da admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.132408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 315/624] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.138407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099687ff-b0a7-48e9-a40b-8348e32b1202 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.154094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099687ff-b0a7-48e9-a40b-8348e32b1202 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.157512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb080e9-6d8a-43ee-9d28-20caeb3551a0 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.157801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb080e9-6d8a-43ee-9d28-20caeb3551a0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.158171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb080e9-6d8a-43ee-9d28-20caeb3551a0 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.160440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 316/625] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:28:57.165907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22a01-9587-4b65-8730-5a2407ec9490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.166216 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac0a1-3802-4170-bac4-061f628f156b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.166467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac0a1-3802-4170-bac4-061f628f156b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.166748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ac0a1-3802-4170-bac4-061f628f156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.167647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22a01-9587-4b65-8730-5a2407ec9490 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.168129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22a01-9587-4b65-8730-5a2407ec9490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.168623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b22a01-9587-4b65-8730-5a2407ec9490 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.193039 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bb2ac0a1-3802-4170-bac4-061f628f156b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:57.194833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bb2ac0a1-3802-4170-bac4-061f628f156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:57.196618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b22a01-9587-4b65-8730-5a2407ec9490 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.198480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b22a01-9587-4b65-8730-5a2407ec9490 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.215600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 317/626] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:28:57.228036 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-94b22a01-9587-4b65-8730-5a2407ec9490 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:57.229712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 310/627] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.235588 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ac0a1-3802-4170-bac4-061f628f156b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.246607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ac0a1-3802-4170-bac4-061f628f156b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.252316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e508214-a6c2-4139-ae6a-8db4b5a17128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.252316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e508214-a6c2-4139-ae6a-8db4b5a17128 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.252316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e508214-a6c2-4139-ae6a-8db4b5a17128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.257237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e508214-a6c2-4139-ae6a-8db4b5a17128 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.258044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e508214-a6c2-4139-ae6a-8db4b5a17128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.258354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e508214-a6c2-4139-ae6a-8db4b5a17128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.260007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e508214-a6c2-4139-ae6a-8db4b5a17128 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.272544 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 318/628] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.277993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22a01-9587-4b65-8730-5a2407ec9490 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.281192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e508214-a6c2-4139-ae6a-8db4b5a17128 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.289293 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b22a01-9587-4b65-8730-5a2407ec9490 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.294319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96a468-2044-42d8-bddc-086a2fef206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.295163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96a468-2044-42d8-bddc-086a2fef206a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.295443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96a468-2044-42d8-bddc-086a2fef206a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.295716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96a468-2044-42d8-bddc-086a2fef206a admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.296246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e508214-a6c2-4139-ae6a-8db4b5a17128 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.306419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96a468-2044-42d8-bddc-086a2fef206a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.307180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cbe29-5be5-475d-8a5b-974ad817cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.308042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cbe29-5be5-475d-8a5b-974ad817cfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.308323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cbe29-5be5-475d-8a5b-974ad817cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.308664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cbe29-5be5-475d-8a5b-974ad817cfd2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.313054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96a468-2044-42d8-bddc-086a2fef206a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.322202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2cbe29-5be5-475d-8a5b-974ad817cfd2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:57.328461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2a96a468-2044-42d8-bddc-086a2fef206a admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 07 02:28:57.329611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0f2cbe29-5be5-475d-8a5b-974ad817cfd2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:57.334637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 319/630] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.334755 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 311/630] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.336177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cbe29-5be5-475d-8a5b-974ad817cfd2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.336418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96a468-2044-42d8-bddc-086a2fef206a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.347215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96a468-2044-42d8-bddc-086a2fef206a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.352639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f5a0e-6b38-4b76-bc69-5ed300b288e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.353544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f5a0e-6b38-4b76-bc69-5ed300b288e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.354005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f5a0e-6b38-4b76-bc69-5ed300b288e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.354529 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f5a0e-6b38-4b76-bc69-5ed300b288e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.355097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cbe29-5be5-475d-8a5b-974ad817cfd2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.355708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f5a0e-6b38-4b76-bc69-5ed300b288e3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.356180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f5a0e-6b38-4b76-bc69-5ed300b288e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.359125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f5a0e-6b38-4b76-bc69-5ed300b288e3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.361757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6603-9776-46b8-b46d-a6760c55342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.362411 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6603-9776-46b8-b46d-a6760c55342d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.362688 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6603-9776-46b8-b46d-a6760c55342d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.362962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6603-9776-46b8-b46d-a6760c55342d admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.363806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6603-9776-46b8-b46d-a6760c55342d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.364117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6603-9776-46b8-b46d-a6760c55342d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.366571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6603-9776-46b8-b46d-a6760c55342d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.374657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 312/631] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:57.381571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f5a0e-6b38-4b76-bc69-5ed300b288e3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.386485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 320/632] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.391751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6603-9776-46b8-b46d-a6760c55342d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.394606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f5a0e-6b38-4b76-bc69-5ed300b288e3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.400713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6c7c7-ba8e-4ca8-8863-30f292cacae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.401791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6c7c7-ba8e-4ca8-8863-30f292cacae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.402269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6c7c7-ba8e-4ca8-8863-30f292cacae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.402701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6c7c7-ba8e-4ca8-8863-30f292cacae4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.403741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6603-9776-46b8-b46d-a6760c55342d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.409414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba837ea6-c8f9-483e-a43a-9917b26e0377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.410231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba837ea6-c8f9-483e-a43a-9917b26e0377 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.410647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba837ea6-c8f9-483e-a43a-9917b26e0377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.410996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba837ea6-c8f9-483e-a43a-9917b26e0377 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.418171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6c7c7-ba8e-4ca8-8863-30f292cacae4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.420724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6c7c7-ba8e-4ca8-8863-30f292cacae4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.423558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba837ea6-c8f9-483e-a43a-9917b26e0377 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.425941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba837ea6-c8f9-483e-a43a-9917b26e0377 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.437786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 321/633] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 02:28:57.441116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-cef6c7c7-ba8e-4ca8-8863-30f292cacae4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:57.442507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 313/634] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:57.443106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba837ea6-c8f9-483e-a43a-9917b26e0377 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.449764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6c7c7-ba8e-4ca8-8863-30f292cacae4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.452454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba837ea6-c8f9-483e-a43a-9917b26e0377 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.457629 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e37f0-a01a-4889-a783-0908d8c8b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.458454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e37f0-a01a-4889-a783-0908d8c8b0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.458974 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e37f0-a01a-4889-a783-0908d8c8b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.459263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e37f0-a01a-4889-a783-0908d8c8b0d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.461546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6c7c7-ba8e-4ca8-8863-30f292cacae4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.466461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3caf-f8af-404f-8fe9-e4eed80ed44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.467429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3caf-f8af-404f-8fe9-e4eed80ed44c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.467907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3caf-f8af-404f-8fe9-e4eed80ed44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.468451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3caf-f8af-404f-8fe9-e4eed80ed44c admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.469379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3caf-f8af-404f-8fe9-e4eed80ed44c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.469983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3caf-f8af-404f-8fe9-e4eed80ed44c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.470694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e37f0-a01a-4889-a783-0908d8c8b0d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.472153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3caf-f8af-404f-8fe9-e4eed80ed44c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.472547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e37f0-a01a-4889-a783-0908d8c8b0d4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.485824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 314/635] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.491865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3caf-f8af-404f-8fe9-e4eed80ed44c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.493019 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-196e37f0-a01a-4889-a783-0908d8c8b0d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:57.494486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 322/636] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.499849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e37f0-a01a-4889-a783-0908d8c8b0d4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.502408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3caf-f8af-404f-8fe9-e4eed80ed44c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.507133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f4e6e-cd2e-4e7f-ad2b-f67f610bd982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.508079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f4e6e-cd2e-4e7f-ad2b-f67f610bd982 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.508547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f4e6e-cd2e-4e7f-ad2b-f67f610bd982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.508965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f4e6e-cd2e-4e7f-ad2b-f67f610bd982 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.512559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e37f0-a01a-4889-a783-0908d8c8b0d4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.517241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f4e6e-cd2e-4e7f-ad2b-f67f610bd982 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.518545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d218bf-23d7-4a05-8a79-a9935a1839f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.519293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d218bf-23d7-4a05-8a79-a9935a1839f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.519672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d218bf-23d7-4a05-8a79-a9935a1839f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.520038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d218bf-23d7-4a05-8a79-a9935a1839f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.520258 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f4e6e-cd2e-4e7f-ad2b-f67f610bd982 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.521077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d218bf-23d7-4a05-8a79-a9935a1839f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.521560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d218bf-23d7-4a05-8a79-a9935a1839f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.524128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d218bf-23d7-4a05-8a79-a9935a1839f4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.536385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 323/637] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.538516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-816f4e6e-cd2e-4e7f-ad2b-f67f610bd982 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 07 02:28:57.539928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 315/638] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:57.542316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d218bf-23d7-4a05-8a79-a9935a1839f4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.545807 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f4e6e-cd2e-4e7f-ad2b-f67f610bd982 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.553983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d218bf-23d7-4a05-8a79-a9935a1839f4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.557195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f4e6e-cd2e-4e7f-ad2b-f67f610bd982 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.559565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1718be-159c-4fee-859a-82ea9df6bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.560684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1718be-159c-4fee-859a-82ea9df6bfcd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.561085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1718be-159c-4fee-859a-82ea9df6bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.561435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1718be-159c-4fee-859a-82ea9df6bfcd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.562945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1367f-b48d-41fe-81f2-6c988e8dc535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.563805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1367f-b48d-41fe-81f2-6c988e8dc535 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.564230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1367f-b48d-41fe-81f2-6c988e8dc535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.564756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1367f-b48d-41fe-81f2-6c988e8dc535 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.565766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1367f-b48d-41fe-81f2-6c988e8dc535 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.566323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1367f-b48d-41fe-81f2-6c988e8dc535 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.568457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1367f-b48d-41fe-81f2-6c988e8dc535 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.568867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1718be-159c-4fee-859a-82ea9df6bfcd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.571344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1718be-159c-4fee-859a-82ea9df6bfcd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.588947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 316/639] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:57.589545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-8d1718be-159c-4fee-859a-82ea9df6bfcd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:57.590873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87672d5a-76b8-4b6f-b6b1-6fbb70f94852 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.590981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 324/640] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.591399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87672d5a-76b8-4b6f-b6b1-6fbb70f94852 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.591678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87672d5a-76b8-4b6f-b6b1-6fbb70f94852 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.595124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1718be-159c-4fee-859a-82ea9df6bfcd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.597662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 317/641] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:57.598913 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87672d5a-76b8-4b6f-b6b1-6fbb70f94852 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.606818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1718be-159c-4fee-859a-82ea9df6bfcd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.611745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32adf9-4e8e-4fd8-a56d-2140a16d7631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.612054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87672d5a-76b8-4b6f-b6b1-6fbb70f94852 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.612966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32adf9-4e8e-4fd8-a56d-2140a16d7631 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.613492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32adf9-4e8e-4fd8-a56d-2140a16d7631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.614067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32adf9-4e8e-4fd8-a56d-2140a16d7631 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.617123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eadbf9d-7c9c-471f-9c1b-107ee39f12f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.617885 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadbf9d-7c9c-471f-9c1b-107ee39f12f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.618305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadbf9d-7c9c-471f-9c1b-107ee39f12f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.618653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eadbf9d-7c9c-471f-9c1b-107ee39f12f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.619516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadbf9d-7c9c-471f-9c1b-107ee39f12f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.619938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadbf9d-7c9c-471f-9c1b-107ee39f12f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.622141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eadbf9d-7c9c-471f-9c1b-107ee39f12f7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.627102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32adf9-4e8e-4fd8-a56d-2140a16d7631 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.629209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32adf9-4e8e-4fd8-a56d-2140a16d7631 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.637896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 318/642] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:57.639269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10286eb-be3a-4b1d-aca1-b3a99553d9f7 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.640468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 325/643] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:57.644165 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10286eb-be3a-4b1d-aca1-b3a99553d9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.644678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10286eb-be3a-4b1d-aca1-b3a99553d9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.645403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32adf9-4e8e-4fd8-a56d-2140a16d7631 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.657107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32adf9-4e8e-4fd8-a56d-2140a16d7631 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.662697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd488d47-7940-4fac-b855-33d45a10f00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.663564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd488d47-7940-4fac-b855-33d45a10f00c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.663669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c10286eb-be3a-4b1d-aca1-b3a99553d9f7 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:57.664121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd488d47-7940-4fac-b855-33d45a10f00c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.664587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd488d47-7940-4fac-b855-33d45a10f00c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.665103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c10286eb-be3a-4b1d-aca1-b3a99553d9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:57.665800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd488d47-7940-4fac-b855-33d45a10f00c admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=612a02fb42af490abcba0e75ec8c759f) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.666373 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd488d47-7940-4fac-b855-33d45a10f00c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.668802 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd488d47-7940-4fac-b855-33d45a10f00c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.677151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 319/644] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:57.677771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10286eb-be3a-4b1d-aca1-b3a99553d9f7 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.680389 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 326/645] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/role_assignments?user.id=612a02fb42af490abcba0e75ec8c759f&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.688483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1c535-1b73-4cbf-891d-8503e30152df None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.688483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1c535-1b73-4cbf-891d-8503e30152df None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.688483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1c535-1b73-4cbf-891d-8503e30152df None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.692028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 327/646] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:28:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:28:57.694654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07230573-d3ad-48ad-986d-ceb5a175dd2c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.694654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07230573-d3ad-48ad-986d-ceb5a175dd2c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.694987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07230573-d3ad-48ad-986d-ceb5a175dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.704025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10286eb-be3a-4b1d-aca1-b3a99553d9f7 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.709919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a32feb-a737-4a5b-8e95-11fe1c5d587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.710747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a32feb-a737-4a5b-8e95-11fe1c5d587d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.711030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a32feb-a737-4a5b-8e95-11fe1c5d587d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.711309 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a32feb-a737-4a5b-8e95-11fe1c5d587d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.721194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-07230573-d3ad-48ad-986d-ceb5a175dd2c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:28:57.722938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-07230573-d3ad-48ad-986d-ceb5a175dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:28:57.724702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a32feb-a737-4a5b-8e95-11fe1c5d587d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.727200 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a32feb-a737-4a5b-8e95-11fe1c5d587d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.740375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 328/647] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:28:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:28:57.740375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07230573-d3ad-48ad-986d-ceb5a175dd2c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.745394 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07230573-d3ad-48ad-986d-ceb5a175dd2c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.751479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6350ff-4e27-4d0a-ad1d-1fc402593783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.752383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6350ff-4e27-4d0a-ad1d-1fc402593783 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.752665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6350ff-4e27-4d0a-ad1d-1fc402593783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.752942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6350ff-4e27-4d0a-ad1d-1fc402593783 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.759889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-25a32feb-a737-4a5b-8e95-11fe1c5d587d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:57.772538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 320/648] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.775985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a32feb-a737-4a5b-8e95-11fe1c5d587d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.781105 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6350ff-4e27-4d0a-ad1d-1fc402593783 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:57.788797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5f6350ff-4e27-4d0a-ad1d-1fc402593783 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:57.789010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a32feb-a737-4a5b-8e95-11fe1c5d587d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.791046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 329/649] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.792156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6350ff-4e27-4d0a-ad1d-1fc402593783 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.798608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbf9ba-b65a-4a68-a6f8-30837dcadfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.799461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbf9ba-b65a-4a68-a6f8-30837dcadfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.800252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbf9ba-b65a-4a68-a6f8-30837dcadfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.800252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbf9ba-b65a-4a68-a6f8-30837dcadfe4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.806771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6350ff-4e27-4d0a-ad1d-1fc402593783 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.812421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d4ee4-9cfc-4c01-9818-be91ddcd160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.813520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d4ee4-9cfc-4c01-9818-be91ddcd160c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.814072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d4ee4-9cfc-4c01-9818-be91ddcd160c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.814540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d4ee4-9cfc-4c01-9818-be91ddcd160c admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.815531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d4ee4-9cfc-4c01-9818-be91ddcd160c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.816035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d4ee4-9cfc-4c01-9818-be91ddcd160c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.817568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbf9ba-b65a-4a68-a6f8-30837dcadfe4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:28:57.818341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d4ee4-9cfc-4c01-9818-be91ddcd160c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.825258 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-dffbf9ba-b65a-4a68-a6f8-30837dcadfe4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:28:57.827135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 321/650] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.832218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbf9ba-b65a-4a68-a6f8-30837dcadfe4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.838134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 330/651] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.843343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d4ee4-9cfc-4c01-9818-be91ddcd160c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.844927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbf9ba-b65a-4a68-a6f8-30837dcadfe4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.850798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792cd96-c2b7-47ba-91ed-080d5fe8196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.852126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792cd96-c2b7-47ba-91ed-080d5fe8196f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.852668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792cd96-c2b7-47ba-91ed-080d5fe8196f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.853221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792cd96-c2b7-47ba-91ed-080d5fe8196f admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.853557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d4ee4-9cfc-4c01-9818-be91ddcd160c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.854199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792cd96-c2b7-47ba-91ed-080d5fe8196f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.854566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792cd96-c2b7-47ba-91ed-080d5fe8196f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.856618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792cd96-c2b7-47ba-91ed-080d5fe8196f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.858831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40cdb3-1b1f-4ff1-a073-1ea8d373d5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.859487 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40cdb3-1b1f-4ff1-a073-1ea8d373d5ff admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.860428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40cdb3-1b1f-4ff1-a073-1ea8d373d5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.860953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40cdb3-1b1f-4ff1-a073-1ea8d373d5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.861974 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40cdb3-1b1f-4ff1-a073-1ea8d373d5ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.862469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40cdb3-1b1f-4ff1-a073-1ea8d373d5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.864304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40cdb3-1b1f-4ff1-a073-1ea8d373d5ff admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.868262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 322/652] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.868933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792cd96-c2b7-47ba-91ed-080d5fe8196f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.878246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 331/653] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.878969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792cd96-c2b7-47ba-91ed-080d5fe8196f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.881970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40cdb3-1b1f-4ff1-a073-1ea8d373d5ff admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.885116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26787e4-be48-42af-8868-9fa4fe498dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.886076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26787e4-be48-42af-8868-9fa4fe498dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.886351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26787e4-be48-42af-8868-9fa4fe498dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.886620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26787e4-be48-42af-8868-9fa4fe498dc0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.893485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40cdb3-1b1f-4ff1-a073-1ea8d373d5ff admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.894425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26787e4-be48-42af-8868-9fa4fe498dc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.896747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26787e4-be48-42af-8868-9fa4fe498dc0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.899631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3d53c-b892-454e-8b59-1fb225b296e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.900566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3d53c-b892-454e-8b59-1fb225b296e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.900949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3d53c-b892-454e-8b59-1fb225b296e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.901324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3d53c-b892-454e-8b59-1fb225b296e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.911624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3d53c-b892-454e-8b59-1fb225b296e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.913362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f26787e4-be48-42af-8868-9fa4fe498dc0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:57.913759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3d53c-b892-454e-8b59-1fb225b296e1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.914539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 323/654] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.915289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26787e4-be48-42af-8868-9fa4fe498dc0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.926182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26787e4-be48-42af-8868-9fa4fe498dc0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.931837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddb439-acc8-45f1-86d6-78d42bd54879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.932623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddb439-acc8-45f1-86d6-78d42bd54879 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.932900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddb439-acc8-45f1-86d6-78d42bd54879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.933169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddb439-acc8-45f1-86d6-78d42bd54879 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.937912 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-e6e3d53c-b892-454e-8b59-1fb225b296e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:57.939367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 332/655] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.940149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3d53c-b892-454e-8b59-1fb225b296e1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.944727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddb439-acc8-45f1-86d6-78d42bd54879 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.947009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddb439-acc8-45f1-86d6-78d42bd54879 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.950560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3d53c-b892-454e-8b59-1fb225b296e1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.955517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75de4b2-352d-414b-a40c-5bcdb1c9057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.956222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75de4b2-352d-414b-a40c-5bcdb1c9057c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.956597 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75de4b2-352d-414b-a40c-5bcdb1c9057c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.956948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75de4b2-352d-414b-a40c-5bcdb1c9057c admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.957807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75de4b2-352d-414b-a40c-5bcdb1c9057c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.958192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75de4b2-352d-414b-a40c-5bcdb1c9057c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.960135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75de4b2-352d-414b-a40c-5bcdb1c9057c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.964158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-63ddb439-acc8-45f1-86d6-78d42bd54879 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:57.966477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 324/656] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:57.967247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddb439-acc8-45f1-86d6-78d42bd54879 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.976660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 333/657] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:57.979136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddb439-acc8-45f1-86d6-78d42bd54879 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:57.982115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75de4b2-352d-414b-a40c-5bcdb1c9057c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:57.983671 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d61207-624b-47a8-9aa5-389f1b484f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:57.984364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61207-624b-47a8-9aa5-389f1b484f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:57.984604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61207-624b-47a8-9aa5-389f1b484f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:57.984873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61207-624b-47a8-9aa5-389f1b484f4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:57.985645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d61207-624b-47a8-9aa5-389f1b484f4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:57.985948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d61207-624b-47a8-9aa5-389f1b484f4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:57.987509 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d61207-624b-47a8-9aa5-389f1b484f4b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:57.994057 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75de4b2-352d-414b-a40c-5bcdb1c9057c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.000411 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567d63-66e7-4ccc-bb4a-af31df871d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.001149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567d63-66e7-4ccc-bb4a-af31df871d2d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.001525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567d63-66e7-4ccc-bb4a-af31df871d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.001952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 325/658] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:58.002084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567d63-66e7-4ccc-bb4a-af31df871d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.002935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d61207-624b-47a8-9aa5-389f1b484f4b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.003044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567d63-66e7-4ccc-bb4a-af31df871d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:58.003388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567d63-66e7-4ccc-bb4a-af31df871d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.005131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567d63-66e7-4ccc-bb4a-af31df871d2d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.013168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d61207-624b-47a8-9aa5-389f1b484f4b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.018248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88933c00-63a4-45b0-8f92-eab73c5f7942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.020243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 334/659] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:58.021068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88933c00-63a4-45b0-8f92-eab73c5f7942 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.021507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88933c00-63a4-45b0-8f92-eab73c5f7942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.022439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567d63-66e7-4ccc-bb4a-af31df871d2d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.022821 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88933c00-63a4-45b0-8f92-eab73c5f7942 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.023760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88933c00-63a4-45b0-8f92-eab73c5f7942 admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=2e738156764e4b038adc89cf114ccda3) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:58.024974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88933c00-63a4-45b0-8f92-eab73c5f7942 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.030314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88933c00-63a4-45b0-8f92-eab73c5f7942 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.033845 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567d63-66e7-4ccc-bb4a-af31df871d2d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.036680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 326/660] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/role_assignments?user.id=2e738156764e4b038adc89cf114ccda3&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:58.037490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88933c00-63a4-45b0-8f92-eab73c5f7942 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.039371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f272d-8cdb-4f04-b08c-60110552c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.040264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f272d-8cdb-4f04-b08c-60110552c66b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.040785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f272d-8cdb-4f04-b08c-60110552c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.041157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f272d-8cdb-4f04-b08c-60110552c66b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.052211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88933c00-63a4-45b0-8f92-eab73c5f7942 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.055681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f272d-8cdb-4f04-b08c-60110552c66b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.058269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a96524-93d9-4d01-b78b-0da51a3b5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.058566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f272d-8cdb-4f04-b08c-60110552c66b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.059613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a96524-93d9-4d01-b78b-0da51a3b5b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.059613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a96524-93d9-4d01-b78b-0da51a3b5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.060098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a96524-93d9-4d01-b78b-0da51a3b5b99 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.071227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a96524-93d9-4d01-b78b-0da51a3b5b99 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.073533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a96524-93d9-4d01-b78b-0da51a3b5b99 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.078131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-667f272d-8cdb-4f04-b08c-60110552c66b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 02:28:58.079585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 335/661] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:58.085301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f272d-8cdb-4f04-b08c-60110552c66b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.092512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a1a96524-93d9-4d01-b78b-0da51a3b5b99 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 07 02:28:58.094806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 327/662] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:58.098243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f272d-8cdb-4f04-b08c-60110552c66b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.103823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95de764-7830-46f8-8adc-c5ee6eb8bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.104556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95de764-7830-46f8-8adc-c5ee6eb8bea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.104834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95de764-7830-46f8-8adc-c5ee6eb8bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.105102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95de764-7830-46f8-8adc-c5ee6eb8bea6 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.105394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a96524-93d9-4d01-b78b-0da51a3b5b99 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.105948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95de764-7830-46f8-8adc-c5ee6eb8bea6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:58.106253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95de764-7830-46f8-8adc-c5ee6eb8bea6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.108222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95de764-7830-46f8-8adc-c5ee6eb8bea6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.125138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a96524-93d9-4d01-b78b-0da51a3b5b99 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.128464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 336/663] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:58.134280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95de764-7830-46f8-8adc-c5ee6eb8bea6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.143202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3e698-0ce6-4a7d-b292-09ebe2137040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.144034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3e698-0ce6-4a7d-b292-09ebe2137040 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.144444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3e698-0ce6-4a7d-b292-09ebe2137040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.144829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95de764-7830-46f8-8adc-c5ee6eb8bea6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.144944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3e698-0ce6-4a7d-b292-09ebe2137040 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.145922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3e698-0ce6-4a7d-b292-09ebe2137040 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:58.146332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3e698-0ce6-4a7d-b292-09ebe2137040 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.148319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3e698-0ce6-4a7d-b292-09ebe2137040 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.149421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9352db-5c68-4227-8fe5-1e126d606623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.150308 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9352db-5c68-4227-8fe5-1e126d606623 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.150583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9352db-5c68-4227-8fe5-1e126d606623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.150906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9352db-5c68-4227-8fe5-1e126d606623 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.178844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9352db-5c68-4227-8fe5-1e126d606623 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.180823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9352db-5c68-4227-8fe5-1e126d606623 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.191731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 328/664] 10.222.0.15 () {56 vars in 1160 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:58.192698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3e698-0ce6-4a7d-b292-09ebe2137040 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.203634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3e698-0ce6-4a7d-b292-09ebe2137040 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.208300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732f7e0-ca38-4e01-a256-1c617e3b6c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.209042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732f7e0-ca38-4e01-a256-1c617e3b6c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.209539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732f7e0-ca38-4e01-a256-1c617e3b6c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.209908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732f7e0-ca38-4e01-a256-1c617e3b6c41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.210804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-2b9352db-5c68-4227-8fe5-1e126d606623 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:58.212390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 337/665] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:58.222068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9352db-5c68-4227-8fe5-1e126d606623 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.226121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732f7e0-ca38-4e01-a256-1c617e3b6c41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.227901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732f7e0-ca38-4e01-a256-1c617e3b6c41 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.238793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 329/666] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:28:58.241610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9352db-5c68-4227-8fe5-1e126d606623 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.245374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732f7e0-ca38-4e01-a256-1c617e3b6c41 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.247508 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38304216-7740-4d2a-92a7-1f552fb21a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.248380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38304216-7740-4d2a-92a7-1f552fb21a70 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.248941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38304216-7740-4d2a-92a7-1f552fb21a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.249355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38304216-7740-4d2a-92a7-1f552fb21a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.250290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38304216-7740-4d2a-92a7-1f552fb21a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:58.250746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38304216-7740-4d2a-92a7-1f552fb21a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.252435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38304216-7740-4d2a-92a7-1f552fb21a70 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.255453 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732f7e0-ca38-4e01-a256-1c617e3b6c41 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.276151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542789d-54fd-4fb4-9b63-06830d047d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.277035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542789d-54fd-4fb4-9b63-06830d047d33 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.277301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542789d-54fd-4fb4-9b63-06830d047d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.277691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542789d-54fd-4fb4-9b63-06830d047d33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.283709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 338/667] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:58.294375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38304216-7740-4d2a-92a7-1f552fb21a70 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.304758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542789d-54fd-4fb4-9b63-06830d047d33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.306602 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542789d-54fd-4fb4-9b63-06830d047d33 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.306756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38304216-7740-4d2a-92a7-1f552fb21a70 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.312338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939c7fc-41b5-4a42-9e74-322febfc796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.313329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939c7fc-41b5-4a42-9e74-322febfc796f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.313755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939c7fc-41b5-4a42-9e74-322febfc796f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.314585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939c7fc-41b5-4a42-9e74-322febfc796f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.322669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939c7fc-41b5-4a42-9e74-322febfc796f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.324889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939c7fc-41b5-4a42-9e74-322febfc796f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.326122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f542789d-54fd-4fb4-9b63-06830d047d33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:28:58.327169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 330/668] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:58.332718 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542789d-54fd-4fb4-9b63-06830d047d33 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.344803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542789d-54fd-4fb4-9b63-06830d047d33 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.346888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-8939c7fc-41b5-4a42-9e74-322febfc796f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:58.348779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 339/669] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:28:58.349551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071fee8-bff0-47c5-ad10-87608b62511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.350732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071fee8-bff0-47c5-ad10-87608b62511b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.351011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071fee8-bff0-47c5-ad10-87608b62511b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.351279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071fee8-bff0-47c5-ad10-87608b62511b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.352003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071fee8-bff0-47c5-ad10-87608b62511b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:58.352303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071fee8-bff0-47c5-ad10-87608b62511b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.353911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071fee8-bff0-47c5-ad10-87608b62511b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.354985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939c7fc-41b5-4a42-9e74-322febfc796f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.368217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939c7fc-41b5-4a42-9e74-322febfc796f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.368830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 331/670] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:58.373711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fdd7f-896a-41db-977d-8e5a88c6b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.373993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071fee8-bff0-47c5-ad10-87608b62511b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.374721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fdd7f-896a-41db-977d-8e5a88c6b7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.375160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fdd7f-896a-41db-977d-8e5a88c6b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.375678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fdd7f-896a-41db-977d-8e5a88c6b7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.376761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fdd7f-896a-41db-977d-8e5a88c6b7c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:58.377210 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fdd7f-896a-41db-977d-8e5a88c6b7c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.379480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fdd7f-896a-41db-977d-8e5a88c6b7c4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.386083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071fee8-bff0-47c5-ad10-87608b62511b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.392064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac0a1c-ee7d-4134-97bb-224527d9bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.392897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac0a1c-ee7d-4134-97bb-224527d9bc0b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.393180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac0a1c-ee7d-4134-97bb-224527d9bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.393457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac0a1c-ee7d-4134-97bb-224527d9bc0b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.395133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 340/671] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:28:58.400482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fdd7f-896a-41db-977d-8e5a88c6b7c4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.402719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac0a1c-ee7d-4134-97bb-224527d9bc0b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.404701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac0a1c-ee7d-4134-97bb-224527d9bc0b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.412025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fdd7f-896a-41db-977d-8e5a88c6b7c4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.417866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c41dd0-cbbd-4028-9c03-bb0375d773a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.419007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c41dd0-cbbd-4028-9c03-bb0375d773a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.419427 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c41dd0-cbbd-4028-9c03-bb0375d773a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.419841 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c41dd0-cbbd-4028-9c03-bb0375d773a6 admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/2074fd021729416ea1c9b596d0bb892b/roles/252e58e0307c43339c5bc8a0d299fea2` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.420493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e6ac0a1c-ee7d-4134-97bb-224527d9bc0b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:28:58.421851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 332/672] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:28:58.427232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac0a1c-ee7d-4134-97bb-224527d9bc0b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.439174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac0a1c-ee7d-4134-97bb-224527d9bc0b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.440086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c41dd0-cbbd-4028-9c03-bb0375d773a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=2074fd021729416ea1c9b596d0bb892b, role_id=252e58e0307c43339c5bc8a0d299fea2)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.443462 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c41dd0-cbbd-4028-9c03-bb0375d773a6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.443758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21306b-e772-4392-ae39-8dd69267b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.444464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21306b-e772-4392-ae39-8dd69267b16b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.444748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21306b-e772-4392-ae39-8dd69267b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.445020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21306b-e772-4392-ae39-8dd69267b16b admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.445811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21306b-e772-4392-ae39-8dd69267b16b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:58.446121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21306b-e772-4392-ae39-8dd69267b16b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.448181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21306b-e772-4392-ae39-8dd69267b16b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.459887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 341/673] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:28:58 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/2074fd021729416ea1c9b596d0bb892b/roles/252e58e0307c43339c5bc8a0d299fea2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:28:58.471286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 333/674] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:28:58.477862 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c41dd0-cbbd-4028-9c03-bb0375d773a6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:28:58.561266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c41dd0-cbbd-4028-9c03-bb0375d773a6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:28:58.571756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed01b91-1a68-4669-a675-daca7971a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:28:58.573422 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01b91-1a68-4669-a675-daca7971a866 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:28:58.573874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01b91-1a68-4669-a675-daca7971a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:28:58.574332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01b91-1a68-4669-a675-daca7971a866 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:28:58.575448 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed01b91-1a68-4669-a675-daca7971a866 admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=b3922641f7c846da98457824bec58652) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:28:58.576214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed01b91-1a68-4669-a675-daca7971a866 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:28:58.578375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed01b91-1a68-4669-a675-daca7971a866 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:28:58.587800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 342/675] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:28:58 2022] GET /identity/v3/role_assignments?user.id=b3922641f7c846da98457824bec58652&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 608 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:00.185683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a56f78-58dd-45c1-9dee-e6088f022f2f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.186697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a56f78-58dd-45c1-9dee-e6088f022f2f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.187211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a56f78-58dd-45c1-9dee-e6088f022f2f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.189493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 334/676] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:00.195003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a559-86e6-4cda-a57f-751a0d119a14 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.195795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a559-86e6-4cda-a57f-751a0d119a14 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.196284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a559-86e6-4cda-a57f-751a0d119a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.224633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6fd4a559-86e6-4cda-a57f-751a0d119a14 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:00.226926 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6fd4a559-86e6-4cda-a57f-751a0d119a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:00.239594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 343/677] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:29:00.275727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a56f78-58dd-45c1-9dee-e6088f022f2f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.293835 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a56f78-58dd-45c1-9dee-e6088f022f2f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.298575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a28ce-7a78-47c4-8e2a-5db17cb3738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.299605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a28ce-7a78-47c4-8e2a-5db17cb3738b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.300084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a28ce-7a78-47c4-8e2a-5db17cb3738b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.300577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a28ce-7a78-47c4-8e2a-5db17cb3738b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.311530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a28ce-7a78-47c4-8e2a-5db17cb3738b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:00.323321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2b0a28ce-7a78-47c4-8e2a-5db17cb3738b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:00.324780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 335/678] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:00.330719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4a559-86e6-4cda-a57f-751a0d119a14 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.340656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4a559-86e6-4cda-a57f-751a0d119a14 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.347910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13a914-650d-43dc-a09f-8d083c32f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.348844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13a914-650d-43dc-a09f-8d083c32f200 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.349343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13a914-650d-43dc-a09f-8d083c32f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.349838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13a914-650d-43dc-a09f-8d083c32f200 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.350786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13a914-650d-43dc-a09f-8d083c32f200 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:00.351295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13a914-650d-43dc-a09f-8d083c32f200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.353136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13a914-650d-43dc-a09f-8d083c32f200 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.366924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 344/679] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:00.372396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a28ce-7a78-47c4-8e2a-5db17cb3738b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.384169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a28ce-7a78-47c4-8e2a-5db17cb3738b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.389108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcdf33-7c2b-46ab-8836-1e9668204de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.390140 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcdf33-7c2b-46ab-8836-1e9668204de6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.390637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcdf33-7c2b-46ab-8836-1e9668204de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.391101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcdf33-7c2b-46ab-8836-1e9668204de6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.402885 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcdf33-7c2b-46ab-8836-1e9668204de6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.405016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcdf33-7c2b-46ab-8836-1e9668204de6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.422721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6bfcdf33-7c2b-46ab-8836-1e9668204de6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:00.424601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 336/680] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:00.429653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13a914-650d-43dc-a09f-8d083c32f200 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.439634 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13a914-650d-43dc-a09f-8d083c32f200 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.444944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595e978-ba81-4f8f-8afc-6ddf78d3081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.445823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595e978-ba81-4f8f-8afc-6ddf78d3081d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.446322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595e978-ba81-4f8f-8afc-6ddf78d3081d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.446806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595e978-ba81-4f8f-8afc-6ddf78d3081d admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.447739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595e978-ba81-4f8f-8afc-6ddf78d3081d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:00.448235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595e978-ba81-4f8f-8afc-6ddf78d3081d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.450042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595e978-ba81-4f8f-8afc-6ddf78d3081d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.463004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 345/681] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:00.469622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcdf33-7c2b-46ab-8836-1e9668204de6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.479982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcdf33-7c2b-46ab-8836-1e9668204de6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.488370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1a5a1-6560-4d81-8033-89376a27cb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.489438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1a5a1-6560-4d81-8033-89376a27cb74 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.489956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1a5a1-6560-4d81-8033-89376a27cb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.490454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1a5a1-6560-4d81-8033-89376a27cb74 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.498588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1a5a1-6560-4d81-8033-89376a27cb74 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.500887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1a5a1-6560-4d81-8033-89376a27cb74 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.516971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b4a1a5a1-6560-4d81-8033-89376a27cb74 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 02:29:00.518922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 337/682] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:00.525689 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595e978-ba81-4f8f-8afc-6ddf78d3081d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.541589 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595e978-ba81-4f8f-8afc-6ddf78d3081d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.549057 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043ce3f-9b3f-4b46-8729-e9f9769c1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.549739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043ce3f-9b3f-4b46-8729-e9f9769c1ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.550021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043ce3f-9b3f-4b46-8729-e9f9769c1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.550300 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043ce3f-9b3f-4b46-8729-e9f9769c1ecd admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.551153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043ce3f-9b3f-4b46-8729-e9f9769c1ecd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:00.551460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043ce3f-9b3f-4b46-8729-e9f9769c1ecd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.553481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043ce3f-9b3f-4b46-8729-e9f9769c1ecd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.576464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 346/683] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:00.581897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1a5a1-6560-4d81-8033-89376a27cb74 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.583177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9994a6e-0862-4acb-b478-0727d29bc6f1 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.583468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9994a6e-0862-4acb-b478-0727d29bc6f1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.583748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9994a6e-0862-4acb-b478-0727d29bc6f1 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.586380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 347/684] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:29:00.591278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1731-1563-48cd-8dcf-87a999ccf8a2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.591563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1731-1563-48cd-8dcf-87a999ccf8a2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.591841 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d1731-1563-48cd-8dcf-87a999ccf8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.596647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1a5a1-6560-4d81-8033-89376a27cb74 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.601405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d0d9d-d5ff-4b50-a1ce-6314e781aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.602329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d0d9d-d5ff-4b50-a1ce-6314e781aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.602834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d0d9d-d5ff-4b50-a1ce-6314e781aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.603304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d0d9d-d5ff-4b50-a1ce-6314e781aad8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.611902 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d0d9d-d5ff-4b50-a1ce-6314e781aad8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.613946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d0d9d-d5ff-4b50-a1ce-6314e781aad8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.623738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 338/685] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:29:00.630327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d0d9d-d5ff-4b50-a1ce-6314e781aad8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.636211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-357d1731-1563-48cd-8dcf-87a999ccf8a2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:00.637414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-357d1731-1563-48cd-8dcf-87a999ccf8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:00.640740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d0d9d-d5ff-4b50-a1ce-6314e781aad8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.646432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314670f-f655-4186-8360-c6af3517874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.648126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314670f-f655-4186-8360-c6af3517874b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.648664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314670f-f655-4186-8360-c6af3517874b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.649139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314670f-f655-4186-8360-c6af3517874b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.654899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 348/686] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:29:00.661403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314670f-f655-4186-8360-c6af3517874b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.663623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314670f-f655-4186-8360-c6af3517874b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.685789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d314670f-f655-4186-8360-c6af3517874b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:00.687579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 339/687] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:00.692685 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d1731-1563-48cd-8dcf-87a999ccf8a2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.703320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d1731-1563-48cd-8dcf-87a999ccf8a2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.708243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa351b7-d35a-444a-84f0-95291a1e7349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.709461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314670f-f655-4186-8360-c6af3517874b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.719878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314670f-f655-4186-8360-c6af3517874b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.720785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa351b7-d35a-444a-84f0-95291a1e7349 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.721465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa351b7-d35a-444a-84f0-95291a1e7349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.722548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa351b7-d35a-444a-84f0-95291a1e7349 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.723987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa351b7-d35a-444a-84f0-95291a1e7349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:00.724950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa351b7-d35a-444a-84f0-95291a1e7349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.727161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa351b7-d35a-444a-84f0-95291a1e7349 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.731740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eece14-33da-4959-a09e-0a758c48ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.732817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eece14-33da-4959-a09e-0a758c48ae12 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.734115 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eece14-33da-4959-a09e-0a758c48ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.734609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eece14-33da-4959-a09e-0a758c48ae12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.754067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 349/688] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:00.755944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eece14-33da-4959-a09e-0a758c48ae12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.758864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eece14-33da-4959-a09e-0a758c48ae12 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.760098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa351b7-d35a-444a-84f0-95291a1e7349 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.779652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa351b7-d35a-444a-84f0-95291a1e7349 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.791471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75c92-09a9-4e50-99b9-9016a665dedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.792737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75c92-09a9-4e50-99b9-9016a665dedc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.793777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75c92-09a9-4e50-99b9-9016a665dedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.794299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75c92-09a9-4e50-99b9-9016a665dedc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.799839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a2eece14-33da-4959-a09e-0a758c48ae12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:00.804038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 340/689] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:00.808787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c75c92-09a9-4e50-99b9-9016a665dedc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.810149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eece14-33da-4959-a09e-0a758c48ae12 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.815447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c75c92-09a9-4e50-99b9-9016a665dedc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.829571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eece14-33da-4959-a09e-0a758c48ae12 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.841855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a62e4-f45e-4b5f-aae8-4333400e808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.842842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a62e4-f45e-4b5f-aae8-4333400e808e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.843327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a62e4-f45e-4b5f-aae8-4333400e808e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.843801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a62e4-f45e-4b5f-aae8-4333400e808e admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.844944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a62e4-f45e-4b5f-aae8-4333400e808e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:00.845452 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a62e4-f45e-4b5f-aae8-4333400e808e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.847179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-39c75c92-09a9-4e50-99b9-9016a665dedc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:00.848546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a62e4-f45e-4b5f-aae8-4333400e808e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.850064 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 350/690] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:00.855534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75c92-09a9-4e50-99b9-9016a665dedc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.873142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75c92-09a9-4e50-99b9-9016a665dedc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.875977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 341/691] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:00.879948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be3539-1c00-4283-a0dd-1d47e684e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.881947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a62e4-f45e-4b5f-aae8-4333400e808e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.889247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be3539-1c00-4283-a0dd-1d47e684e458 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.889247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be3539-1c00-4283-a0dd-1d47e684e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.889585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be3539-1c00-4283-a0dd-1d47e684e458 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.890326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be3539-1c00-4283-a0dd-1d47e684e458 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:00.890633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be3539-1c00-4283-a0dd-1d47e684e458 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.892533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be3539-1c00-4283-a0dd-1d47e684e458 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.893910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a62e4-f45e-4b5f-aae8-4333400e808e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.898989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f22caa-e3b9-4587-a870-8b7a070590b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.899994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f22caa-e3b9-4587-a870-8b7a070590b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.900513 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f22caa-e3b9-4587-a870-8b7a070590b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.901055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f22caa-e3b9-4587-a870-8b7a070590b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.902075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f22caa-e3b9-4587-a870-8b7a070590b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.904303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f22caa-e3b9-4587-a870-8b7a070590b4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.923072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 351/692] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:00.924114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be3539-1c00-4283-a0dd-1d47e684e458 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:00.932896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 342/693] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:29:00 2022] POST /identity/v3/users => generated 254 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:00.937991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be3539-1c00-4283-a0dd-1d47e684e458 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:00.943068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cf25-c155-48ea-b6ee-afdb6acec9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:00.944391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cf25-c155-48ea-b6ee-afdb6acec9df admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:00.944773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cf25-c155-48ea-b6ee-afdb6acec9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:00.945119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cf25-c155-48ea-b6ee-afdb6acec9df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:00.946132 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cf25-c155-48ea-b6ee-afdb6acec9df admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=904a4e5f54e642eda58c90930b5858f4) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:00.946542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cf25-c155-48ea-b6ee-afdb6acec9df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:00.948623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cf25-c155-48ea-b6ee-afdb6acec9df admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:00.956015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 352/694] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:00 2022] GET /identity/v3/role_assignments?user.id=904a4e5f54e642eda58c90930b5858f4&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:01.092052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e5293-166e-4c5e-8915-54b1f7015b24 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.092616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e5293-166e-4c5e-8915-54b1f7015b24 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.093040 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e5293-166e-4c5e-8915-54b1f7015b24 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.095437 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 343/695] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:01.112029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486eec-6e53-4150-bb4a-c1a32e0c7986 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.112484 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486eec-6e53-4150-bb4a-c1a32e0c7986 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.112897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486eec-6e53-4150-bb4a-c1a32e0c7986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.137365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d0486eec-6e53-4150-bb4a-c1a32e0c7986 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:01.138566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d0486eec-6e53-4150-bb4a-c1a32e0c7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:01.147800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 353/696] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:29:01.173293 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e5293-166e-4c5e-8915-54b1f7015b24 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.189993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e5293-166e-4c5e-8915-54b1f7015b24 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.195985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.196811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.197095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.197375 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.198122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.199341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:01.199341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:29:01.199341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:29:01.200316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.219361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 07 02:29:01.220684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 344/697] 10.222.0.15 () {56 vars in 1150 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:01.227178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0486eec-6e53-4150-bb4a-c1a32e0c7986 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.239197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0486eec-6e53-4150-bb4a-c1a32e0c7986 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.246524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02922f-c79e-4742-9649-d1ffb745e433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.247189 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02922f-c79e-4742-9649-d1ffb745e433 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.247469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02922f-c79e-4742-9649-d1ffb745e433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.247743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02922f-c79e-4742-9649-d1ffb745e433 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.248503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02922f-c79e-4742-9649-d1ffb745e433 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:01.248809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02922f-c79e-4742-9649-d1ffb745e433 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.249832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-3b02922f-c79e-4742-9649-d1ffb745e433 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:01.249832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:29:01.249832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:29:01.250698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02922f-c79e-4742-9649-d1ffb745e433 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.257723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 354/698] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:01.263289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.277426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d941f00-5a92-4dfa-9fe1-edc32147e620 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.284030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d715c54-2b0c-4bd4-965c-63aff6d67586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.284729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715c54-2b0c-4bd4-965c-63aff6d67586 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.285010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715c54-2b0c-4bd4-965c-63aff6d67586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.285283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d715c54-2b0c-4bd4-965c-63aff6d67586 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.286007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d715c54-2b0c-4bd4-965c-63aff6d67586 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:01.286311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d715c54-2b0c-4bd4-965c-63aff6d67586 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.287866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-0d715c54-2b0c-4bd4-965c-63aff6d67586 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:01.287866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:29:01.287866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:29:01.288785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d715c54-2b0c-4bd4-965c-63aff6d67586 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.299046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 345/699] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:01.369276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa53680-b411-41d4-b9b0-f56dd54ebdb3 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.369610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa53680-b411-41d4-b9b0-f56dd54ebdb3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.369827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa53680-b411-41d4-b9b0-f56dd54ebdb3 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.371657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 355/700] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:01.378032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da72906-6cd3-4260-b98d-9c6f6be8324a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.378312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da72906-6cd3-4260-b98d-9c6f6be8324a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.378590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da72906-6cd3-4260-b98d-9c6f6be8324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.398149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3da72906-6cd3-4260-b98d-9c6f6be8324a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:01.399363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3da72906-6cd3-4260-b98d-9c6f6be8324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:01.407834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 346/701] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 07 02:29:01.433533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa53680-b411-41d4-b9b0-f56dd54ebdb3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.459904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa53680-b411-41d4-b9b0-f56dd54ebdb3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.464873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b580ccc-6533-433c-b851-e3cc9f878791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.465699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b580ccc-6533-433c-b851-e3cc9f878791 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.465981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b580ccc-6533-433c-b851-e3cc9f878791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.466255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b580ccc-6533-433c-b851-e3cc9f878791 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.489065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b580ccc-6533-433c-b851-e3cc9f878791 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:01.496131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-4b580ccc-6533-433c-b851-e3cc9f878791 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:29:01.497697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 356/702] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:01.503484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da72906-6cd3-4260-b98d-9c6f6be8324a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.515444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da72906-6cd3-4260-b98d-9c6f6be8324a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.520334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d9e3c-da1f-45d7-9a32-b73916d145bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.521478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d9e3c-da1f-45d7-9a32-b73916d145bd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.522510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d9e3c-da1f-45d7-9a32-b73916d145bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.522980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d9e3c-da1f-45d7-9a32-b73916d145bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.523990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d9e3c-da1f-45d7-9a32-b73916d145bd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:01.524540 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d9e3c-da1f-45d7-9a32-b73916d145bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.526367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d9e3c-da1f-45d7-9a32-b73916d145bd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.536916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 347/703] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:01.543291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b580ccc-6533-433c-b851-e3cc9f878791 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.555677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b580ccc-6533-433c-b851-e3cc9f878791 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.563238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f6d29-a6e3-4cff-b676-fc4f0f5e7b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.564021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f6d29-a6e3-4cff-b676-fc4f0f5e7b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.564296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f6d29-a6e3-4cff-b676-fc4f0f5e7b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.564639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f6d29-a6e3-4cff-b676-fc4f0f5e7b55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.575955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f6d29-a6e3-4cff-b676-fc4f0f5e7b55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.578051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f6d29-a6e3-4cff-b676-fc4f0f5e7b55 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.595274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-bb2f6d29-a6e3-4cff-b676-fc4f0f5e7b55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:01.596836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 357/704] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:01.602772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d9e3c-da1f-45d7-9a32-b73916d145bd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.612682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d9e3c-da1f-45d7-9a32-b73916d145bd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.617305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e46e73-9d89-4fb6-984e-2f599b539b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.617947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e46e73-9d89-4fb6-984e-2f599b539b4a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.618224 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e46e73-9d89-4fb6-984e-2f599b539b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.618496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e46e73-9d89-4fb6-984e-2f599b539b4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.619271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e46e73-9d89-4fb6-984e-2f599b539b4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:01.619573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e46e73-9d89-4fb6-984e-2f599b539b4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.621282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e46e73-9d89-4fb6-984e-2f599b539b4a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.638664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 348/705] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:01.644764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f6d29-a6e3-4cff-b676-fc4f0f5e7b55 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.659302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f6d29-a6e3-4cff-b676-fc4f0f5e7b55 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.674818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3d67-87cf-44c0-8f05-7464f192e057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.674818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3d67-87cf-44c0-8f05-7464f192e057 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.674818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3d67-87cf-44c0-8f05-7464f192e057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.674818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee3d67-87cf-44c0-8f05-7464f192e057 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.685472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3d67-87cf-44c0-8f05-7464f192e057 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.687495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee3d67-87cf-44c0-8f05-7464f192e057 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.711637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6eee3d67-87cf-44c0-8f05-7464f192e057 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 02:29:01.717298 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 358/706] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:01.718682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e46e73-9d89-4fb6-984e-2f599b539b4a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.737310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e46e73-9d89-4fb6-984e-2f599b539b4a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.752985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a63c1c-885e-4847-b99e-ed84303ac39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.753662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a63c1c-885e-4847-b99e-ed84303ac39f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.753945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a63c1c-885e-4847-b99e-ed84303ac39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.754221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a63c1c-885e-4847-b99e-ed84303ac39f admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.755068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a63c1c-885e-4847-b99e-ed84303ac39f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:01.755374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a63c1c-885e-4847-b99e-ed84303ac39f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.757287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a63c1c-885e-4847-b99e-ed84303ac39f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.788537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 349/707] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:01.793692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3d67-87cf-44c0-8f05-7464f192e057 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.798443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d861668-3aaf-438b-863f-c4e9f3fbb10b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.798731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d861668-3aaf-438b-863f-c4e9f3fbb10b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.799005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d861668-3aaf-438b-863f-c4e9f3fbb10b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.801128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 350/708] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:29:01.808721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c7922-50a6-4038-a6fc-7ef1c4e47348 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.809005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c7922-50a6-4038-a6fc-7ef1c4e47348 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.809281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c7922-50a6-4038-a6fc-7ef1c4e47348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.809380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee3d67-87cf-44c0-8f05-7464f192e057 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.825556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e5563-bc06-451d-9fc6-94a737942a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.826462 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e5563-bc06-451d-9fc6-94a737942a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.826741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e5563-bc06-451d-9fc6-94a737942a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.827015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e5563-bc06-451d-9fc6-94a737942a25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.828653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-046c7922-50a6-4038-a6fc-7ef1c4e47348 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:01.829940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-046c7922-50a6-4038-a6fc-7ef1c4e47348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:01.838815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 351/709] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:29:01.845509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e5563-bc06-451d-9fc6-94a737942a25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.847265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e5563-bc06-451d-9fc6-94a737942a25 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.862259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 359/710] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:29:01.867749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c7922-50a6-4038-a6fc-7ef1c4e47348 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.879488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e5563-bc06-451d-9fc6-94a737942a25 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.881859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c7922-50a6-4038-a6fc-7ef1c4e47348 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.886594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85795e-185d-4add-b5c1-b8ddd13b57d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.887374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85795e-185d-4add-b5c1-b8ddd13b57d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.887655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85795e-185d-4add-b5c1-b8ddd13b57d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.888025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85795e-185d-4add-b5c1-b8ddd13b57d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.893215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e5563-bc06-451d-9fc6-94a737942a25 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.900282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85795e-185d-4add-b5c1-b8ddd13b57d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.902210 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85795e-185d-4add-b5c1-b8ddd13b57d4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.906984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.907781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.908062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.908329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] PATH_INFO: `/v3/services/network` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.909016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.910032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:01.910032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:29:01.910032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:29:01.910892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.926352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-1a85795e-185d-4add-b5c1-b8ddd13b57d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:01.927979 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 352/711] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:01.933073 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85795e-185d-4add-b5c1-b8ddd13b57d4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.936284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 07 02:29:01.937739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 360/712] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/services/network => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:01.943286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:01.946322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85795e-185d-4add-b5c1-b8ddd13b57d4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.955283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006edef3-b2b7-4dc9-889b-142dc71971c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.957077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006edef3-b2b7-4dc9-889b-142dc71971c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.957364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006edef3-b2b7-4dc9-889b-142dc71971c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.958903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006edef3-b2b7-4dc9-889b-142dc71971c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.961290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006edef3-b2b7-4dc9-889b-142dc71971c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:01.961607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006edef3-b2b7-4dc9-889b-142dc71971c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.972585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006edef3-b2b7-4dc9-889b-142dc71971c1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.976732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65184-1eb4-46b9-809c-8ab68a1522cf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:01.987029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258d56-5f09-460e-8b38-25de904d22c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:01.988227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258d56-5f09-460e-8b38-25de904d22c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:01.988560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258d56-5f09-460e-8b38-25de904d22c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:01.990395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258d56-5f09-460e-8b38-25de904d22c9 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:01.991152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258d56-5f09-460e-8b38-25de904d22c9 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:01.991459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258d56-5f09-460e-8b38-25de904d22c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:01.994045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258d56-5f09-460e-8b38-25de904d22c9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:01.997789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 353/713] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:02.001904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 361/714] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:02.007971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006edef3-b2b7-4dc9-889b-142dc71971c1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:02.009276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258d56-5f09-460e-8b38-25de904d22c9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:02.025193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006edef3-b2b7-4dc9-889b-142dc71971c1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:02.029784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258d56-5f09-460e-8b38-25de904d22c9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:02.034212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daf9c5-a87f-45aa-ab97-2e1356c673ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:02.035401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daf9c5-a87f-45aa-ab97-2e1356c673ec admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:02.036204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daf9c5-a87f-45aa-ab97-2e1356c673ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:02.036511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02daf9c5-a87f-45aa-ab97-2e1356c673ec admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:02.037754 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daf9c5-a87f-45aa-ab97-2e1356c673ec admin admin] RBAC: Adding query filter params (type=network) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:02.038439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daf9c5-a87f-45aa-ab97-2e1356c673ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:02.039988 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19b5b2-0020-486d-882d-d942099fcbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:02.041881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02daf9c5-a87f-45aa-ab97-2e1356c673ec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:02.042162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19b5b2-0020-486d-882d-d942099fcbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:02.042442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19b5b2-0020-486d-882d-d942099fcbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:02.042713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19b5b2-0020-486d-882d-d942099fcbe7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:02.053413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 354/715] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:02.063112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19b5b2-0020-486d-882d-d942099fcbe7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:02.064471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19b5b2-0020-486d-882d-d942099fcbe7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:02.091320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-de19b5b2-0020-486d-882d-d942099fcbe7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:02.092886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 362/716] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:02.098865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daf9c5-a87f-45aa-ab97-2e1356c673ec admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:02.115194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02daf9c5-a87f-45aa-ab97-2e1356c673ec admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:02.124674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487a436-6e59-4cbe-aa3f-3e205cb39207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:02.125399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487a436-6e59-4cbe-aa3f-3e205cb39207 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:02.125736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487a436-6e59-4cbe-aa3f-3e205cb39207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:02.126018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487a436-6e59-4cbe-aa3f-3e205cb39207 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:02.126826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487a436-6e59-4cbe-aa3f-3e205cb39207 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:02.127187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487a436-6e59-4cbe-aa3f-3e205cb39207 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:02.129137 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487a436-6e59-4cbe-aa3f-3e205cb39207 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:02.154432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 355/717] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:02.160561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19b5b2-0020-486d-882d-d942099fcbe7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:02.179707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19b5b2-0020-486d-882d-d942099fcbe7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:02.185989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc983b0-8c52-483d-bc17-d73a6dd8f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:02.186878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc983b0-8c52-483d-bc17-d73a6dd8f65d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:02.187304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc983b0-8c52-483d-bc17-d73a6dd8f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:02.187721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc983b0-8c52-483d-bc17-d73a6dd8f65d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:02.188757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc983b0-8c52-483d-bc17-d73a6dd8f65d admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=2074fd021729416ea1c9b596d0bb892b) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:02.189231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc983b0-8c52-483d-bc17-d73a6dd8f65d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:02.191219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc983b0-8c52-483d-bc17-d73a6dd8f65d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:02.204897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 363/718] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:02 2022] GET /identity/v3/role_assignments?user.id=2074fd021729416ea1c9b596d0bb892b&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:03.598743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3767a-da22-4bd8-aa0b-e428555897d1 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.599301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3767a-da22-4bd8-aa0b-e428555897d1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.599301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3767a-da22-4bd8-aa0b-e428555897d1 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.602035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 356/719] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:03.607139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860234f-0551-4d17-8122-7bdcc093c86a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.607962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860234f-0551-4d17-8122-7bdcc093c86a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.608568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860234f-0551-4d17-8122-7bdcc093c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.646463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8860234f-0551-4d17-8122-7bdcc093c86a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:03.648171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8860234f-0551-4d17-8122-7bdcc093c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:03.660142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 364/720] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:29:03.690324 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3767a-da22-4bd8-aa0b-e428555897d1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:03.713901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3767a-da22-4bd8-aa0b-e428555897d1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:03.722719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc35c74-602f-4ea6-befb-40af88faf80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:03.723605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc35c74-602f-4ea6-befb-40af88faf80a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.723898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc35c74-602f-4ea6-befb-40af88faf80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.724169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc35c74-602f-4ea6-befb-40af88faf80a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.745252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc35c74-602f-4ea6-befb-40af88faf80a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:03.752206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-1cc35c74-602f-4ea6-befb-40af88faf80a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:03.754734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 357/721] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:03.759510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860234f-0551-4d17-8122-7bdcc093c86a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:03.769110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860234f-0551-4d17-8122-7bdcc093c86a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:03.783281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a364d-8b7f-498e-bd2f-2b3ffc49a23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:03.784195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a364d-8b7f-498e-bd2f-2b3ffc49a23b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.784706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a364d-8b7f-498e-bd2f-2b3ffc49a23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.785203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a364d-8b7f-498e-bd2f-2b3ffc49a23b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.786194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a364d-8b7f-498e-bd2f-2b3ffc49a23b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:03.786702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a364d-8b7f-498e-bd2f-2b3ffc49a23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:03.789153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a364d-8b7f-498e-bd2f-2b3ffc49a23b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:03.798569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 365/722] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:03.803854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc35c74-602f-4ea6-befb-40af88faf80a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:03.817494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc35c74-602f-4ea6-befb-40af88faf80a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:03.824625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912182f-cd68-4795-9334-e66b88769972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:03.825417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912182f-cd68-4795-9334-e66b88769972 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.825958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912182f-cd68-4795-9334-e66b88769972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.826245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912182f-cd68-4795-9334-e66b88769972 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.847995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912182f-cd68-4795-9334-e66b88769972 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:03.850494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912182f-cd68-4795-9334-e66b88769972 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:03.856515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946db50f-567e-4c1a-9577-b837f24c1e98 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.856802 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946db50f-567e-4c1a-9577-b837f24c1e98 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.857071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946db50f-567e-4c1a-9577-b837f24c1e98 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.859260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 366/723] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:29:03.864531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db651c30-c636-4ad2-845f-0640ce2dc081 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.864819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db651c30-c636-4ad2-845f-0640ce2dc081 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.865092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db651c30-c636-4ad2-845f-0640ce2dc081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.876791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-1912182f-cd68-4795-9334-e66b88769972 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:03.882685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 358/724] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:03.883766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-db651c30-c636-4ad2-845f-0640ce2dc081 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:03.885046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-db651c30-c636-4ad2-845f-0640ce2dc081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:03.889272 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912182f-cd68-4795-9334-e66b88769972 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:03.893208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 367/725] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 07 02:29:03.910776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912182f-cd68-4795-9334-e66b88769972 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:03.918121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db651c30-c636-4ad2-845f-0640ce2dc081 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:03.925125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0466ff-edc1-440b-96a2-4a0d185264d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:03.925820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0466ff-edc1-440b-96a2-4a0d185264d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.926112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0466ff-edc1-440b-96a2-4a0d185264d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.926391 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0466ff-edc1-440b-96a2-4a0d185264d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.927133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0466ff-edc1-440b-96a2-4a0d185264d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:03.927442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0466ff-edc1-440b-96a2-4a0d185264d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:03.927803 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db651c30-c636-4ad2-845f-0640ce2dc081 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:03.929115 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0466ff-edc1-440b-96a2-4a0d185264d4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:03.933536 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa63c0f-56c5-4876-b196-4dc5d3b1f3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:03.934278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa63c0f-56c5-4876-b196-4dc5d3b1f3de admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.934603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa63c0f-56c5-4876-b196-4dc5d3b1f3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.934877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa63c0f-56c5-4876-b196-4dc5d3b1f3de admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.935612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa63c0f-56c5-4876-b196-4dc5d3b1f3de admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:03.937243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-7fa63c0f-56c5-4876-b196-4dc5d3b1f3de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:03.937243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:29:03.937243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:29:03.938701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa63c0f-56c5-4876-b196-4dc5d3b1f3de admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:03.944509 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 359/726] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:03.948687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b235bb7-3531-4c56-a55b-8d2f7ca73273 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.949068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b235bb7-3531-4c56-a55b-8d2f7ca73273 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.949385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b235bb7-3531-4c56-a55b-8d2f7ca73273 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.951514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 360/727] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:03.952243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b235bb7-3531-4c56-a55b-8d2f7ca73273 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:03.964860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 368/728] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:29:03 2022] POST /identity/v3/services => generated 251 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:29:03.966327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1631-4bbe-4e01-8df1-4a3f8c5abe25 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.966715 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1631-4bbe-4e01-8df1-4a3f8c5abe25 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.967093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1631-4bbe-4e01-8df1-4a3f8c5abe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.987946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-816a1631-4bbe-4e01-8df1-4a3f8c5abe25 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:03.989090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b235bb7-3531-4c56-a55b-8d2f7ca73273 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:03.989281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-816a1631-4bbe-4e01-8df1-4a3f8c5abe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:03.994118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c010a-d8d7-4920-89a3-81983785d5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:03.995009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c010a-d8d7-4920-89a3-81983785d5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:03.995358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c010a-d8d7-4920-89a3-81983785d5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:03.995780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c010a-d8d7-4920-89a3-81983785d5e8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:03.998320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 369/729] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:03 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:04.007110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c010a-d8d7-4920-89a3-81983785d5e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.009354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c010a-d8d7-4920-89a3-81983785d5e8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.023317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1631-4bbe-4e01-8df1-4a3f8c5abe25 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.025046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f67c010a-d8d7-4920-89a3-81983785d5e8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 02:29:04.028467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 361/730] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Feb 7 02:29:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:04.034445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c010a-d8d7-4920-89a3-81983785d5e8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.037028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1631-4bbe-4e01-8df1-4a3f8c5abe25 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.042786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95aeb2-d797-42ae-ace7-f862a053e07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.043912 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95aeb2-d797-42ae-ace7-f862a053e07a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.044254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95aeb2-d797-42ae-ace7-f862a053e07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.044714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95aeb2-d797-42ae-ace7-f862a053e07a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.047306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c010a-d8d7-4920-89a3-81983785d5e8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.052764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b326f-c2fb-4e2d-a0bf-1edfb989c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.053729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b326f-c2fb-4e2d-a0bf-1edfb989c0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.054010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b326f-c2fb-4e2d-a0bf-1edfb989c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.054284 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b326f-c2fb-4e2d-a0bf-1edfb989c0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.055268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b326f-c2fb-4e2d-a0bf-1edfb989c0e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:04.055723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b326f-c2fb-4e2d-a0bf-1edfb989c0e8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.056002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95aeb2-d797-42ae-ace7-f862a053e07a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:04.057615 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b326f-c2fb-4e2d-a0bf-1edfb989c0e8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.063703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-eb95aeb2-d797-42ae-ace7-f862a053e07a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:29:04.067400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 370/731] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:04.071716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95aeb2-d797-42ae-ace7-f862a053e07a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.083355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95aeb2-d797-42ae-ace7-f862a053e07a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.089049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddc9ca-29e8-4f05-bced-c2db94717d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.089787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddc9ca-29e8-4f05-bced-c2db94717d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.090070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddc9ca-29e8-4f05-bced-c2db94717d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.090400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddc9ca-29e8-4f05-bced-c2db94717d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.091179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddc9ca-29e8-4f05-bced-c2db94717d49 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:04.091541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddc9ca-29e8-4f05-bced-c2db94717d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.092397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 362/732] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:04.093346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddc9ca-29e8-4f05-bced-c2db94717d49 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.099225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b326f-c2fb-4e2d-a0bf-1edfb989c0e8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.105276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 371/733] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:04.110965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddc9ca-29e8-4f05-bced-c2db94717d49 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.118947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b326f-c2fb-4e2d-a0bf-1edfb989c0e8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.128185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55ffa-e875-46a5-b3ac-0fe7199aed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.129792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddc9ca-29e8-4f05-bced-c2db94717d49 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.130893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55ffa-e875-46a5-b3ac-0fe7199aed94 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.131983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55ffa-e875-46a5-b3ac-0fe7199aed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.133276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55ffa-e875-46a5-b3ac-0fe7199aed94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.142114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0b04e-eb1a-4d43-86ee-760d46faf0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.143318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0b04e-eb1a-4d43-86ee-760d46faf0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.145457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0b04e-eb1a-4d43-86ee-760d46faf0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.145971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0b04e-eb1a-4d43-86ee-760d46faf0e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.154706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d55ffa-e875-46a5-b3ac-0fe7199aed94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.159905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d55ffa-e875-46a5-b3ac-0fe7199aed94 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.168518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0b04e-eb1a-4d43-86ee-760d46faf0e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.173542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0b04e-eb1a-4d43-86ee-760d46faf0e1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.195449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-76d55ffa-e875-46a5-b3ac-0fe7199aed94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:04.197328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 363/734] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:04.202544 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-14f0b04e-eb1a-4d43-86ee-760d46faf0e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:04.207890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 372/735] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:04.209161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55ffa-e875-46a5-b3ac-0fe7199aed94 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.209994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0b04e-eb1a-4d43-86ee-760d46faf0e1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.219846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0b04e-eb1a-4d43-86ee-760d46faf0e1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.222316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d55ffa-e875-46a5-b3ac-0fe7199aed94 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.224561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897030eb-bec2-4088-a37a-44b5c6ba20d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.225260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897030eb-bec2-4088-a37a-44b5c6ba20d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.225516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897030eb-bec2-4088-a37a-44b5c6ba20d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.225788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897030eb-bec2-4088-a37a-44b5c6ba20d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.226528 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897030eb-bec2-4088-a37a-44b5c6ba20d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:04.228003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897030eb-bec2-4088-a37a-44b5c6ba20d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.228658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897030eb-bec2-4088-a37a-44b5c6ba20d2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.230075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6a7e-04a7-4752-bff0-8de1daa130fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.231016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6a7e-04a7-4752-bff0-8de1daa130fa admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.231482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6a7e-04a7-4752-bff0-8de1daa130fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.231939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda6a7e-04a7-4752-bff0-8de1daa130fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.232915 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6a7e-04a7-4752-bff0-8de1daa130fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:04.233422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6a7e-04a7-4752-bff0-8de1daa130fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.235226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda6a7e-04a7-4752-bff0-8de1daa130fa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.244457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 373/736] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:04.246062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897030eb-bec2-4088-a37a-44b5c6ba20d2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.249579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 364/737] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:04.254927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6a7e-04a7-4752-bff0-8de1daa130fa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.256779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897030eb-bec2-4088-a37a-44b5c6ba20d2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.261392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a2d13-57db-4a4b-9b60-7d8107aae1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.262178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a2d13-57db-4a4b-9b60-7d8107aae1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.262458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a2d13-57db-4a4b-9b60-7d8107aae1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.262724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a2d13-57db-4a4b-9b60-7d8107aae1b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.268380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda6a7e-04a7-4752-bff0-8de1daa130fa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.271034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a2d13-57db-4a4b-9b60-7d8107aae1b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.273887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a2d13-57db-4a4b-9b60-7d8107aae1b1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.274350 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b4854-01b3-41db-b634-1cb1b51712bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.275458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b4854-01b3-41db-b634-1cb1b51712bd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.275987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b4854-01b3-41db-b634-1cb1b51712bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.276482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b4854-01b3-41db-b634-1cb1b51712bd admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.285156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b4854-01b3-41db-b634-1cb1b51712bd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.287500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b4854-01b3-41db-b634-1cb1b51712bd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.287978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-ab9a2d13-57db-4a4b-9b60-7d8107aae1b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:04.293779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 374/738] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:04.294956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a2d13-57db-4a4b-9b60-7d8107aae1b1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.303069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f29b4854-01b3-41db-b634-1cb1b51712bd admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 02:29:04.304640 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 365/739] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:04.308391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a2d13-57db-4a4b-9b60-7d8107aae1b1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.310342 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b4854-01b3-41db-b634-1cb1b51712bd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.313286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339a1b5-ca8d-41c1-9bb6-9c121cb2ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.314152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339a1b5-ca8d-41c1-9bb6-9c121cb2ca20 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.314611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339a1b5-ca8d-41c1-9bb6-9c121cb2ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.315081 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339a1b5-ca8d-41c1-9bb6-9c121cb2ca20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.316020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339a1b5-ca8d-41c1-9bb6-9c121cb2ca20 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:04.316547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339a1b5-ca8d-41c1-9bb6-9c121cb2ca20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.319131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339a1b5-ca8d-41c1-9bb6-9c121cb2ca20 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.321394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b4854-01b3-41db-b634-1cb1b51712bd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.326179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506e9e0-9e5d-4d7d-bc2b-09724eb69f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.326918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506e9e0-9e5d-4d7d-bc2b-09724eb69f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.327293 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506e9e0-9e5d-4d7d-bc2b-09724eb69f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.327662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506e9e0-9e5d-4d7d-bc2b-09724eb69f12 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.329433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506e9e0-9e5d-4d7d-bc2b-09724eb69f12 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:04.329836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506e9e0-9e5d-4d7d-bc2b-09724eb69f12 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.331734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506e9e0-9e5d-4d7d-bc2b-09724eb69f12 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.339323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 375/740] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:04.340699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339a1b5-ca8d-41c1-9bb6-9c121cb2ca20 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.350631 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 366/741] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:04.351207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339a1b5-ca8d-41c1-9bb6-9c121cb2ca20 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.356431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506e9e0-9e5d-4d7d-bc2b-09724eb69f12 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.357723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec45080-5a32-4125-89f7-7917429617c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.358856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec45080-5a32-4125-89f7-7917429617c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.359373 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec45080-5a32-4125-89f7-7917429617c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.359823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec45080-5a32-4125-89f7-7917429617c6 admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/904a4e5f54e642eda58c90930b5858f4/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.362154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec45080-5a32-4125-89f7-7917429617c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=904a4e5f54e642eda58c90930b5858f4, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.365165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec45080-5a32-4125-89f7-7917429617c6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.366450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506e9e0-9e5d-4d7d-bc2b-09724eb69f12 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.372377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b441-828d-41fe-9d1b-ad1336cc09f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.373184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b441-828d-41fe-9d1b-ad1336cc09f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.373434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b441-828d-41fe-9d1b-ad1336cc09f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.373806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680b441-828d-41fe-9d1b-ad1336cc09f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.382456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 376/742] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:29:04 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/904a4e5f54e642eda58c90930b5858f4/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:29:04.383401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680b441-828d-41fe-9d1b-ad1336cc09f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.385269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680b441-828d-41fe-9d1b-ad1336cc09f5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.400448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 367/743] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:04.402047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec45080-5a32-4125-89f7-7917429617c6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.473133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec45080-5a32-4125-89f7-7917429617c6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.478404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5ccfd-0f46-41f3-af7c-f644a83e60c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.479487 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5ccfd-0f46-41f3-af7c-f644a83e60c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.479977 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5ccfd-0f46-41f3-af7c-f644a83e60c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.480507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5ccfd-0f46-41f3-af7c-f644a83e60c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.493374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5ccfd-0f46-41f3-af7c-f644a83e60c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.495646 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5ccfd-0f46-41f3-af7c-f644a83e60c2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.523367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-dfe5ccfd-0f46-41f3-af7c-f644a83e60c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:04.525317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 377/744] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:04.530568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b441-828d-41fe-9d1b-ad1336cc09f5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.547238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680b441-828d-41fe-9d1b-ad1336cc09f5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.558024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405bcc0-2761-4e37-ba32-a235b3c26279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.558774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405bcc0-2761-4e37-ba32-a235b3c26279 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.559123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405bcc0-2761-4e37-ba32-a235b3c26279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.559461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405bcc0-2761-4e37-ba32-a235b3c26279 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.560263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405bcc0-2761-4e37-ba32-a235b3c26279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:04.560660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405bcc0-2761-4e37-ba32-a235b3c26279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.562317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405bcc0-2761-4e37-ba32-a235b3c26279 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.582392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 368/745] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:04.587883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5ccfd-0f46-41f3-af7c-f644a83e60c2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.601961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5ccfd-0f46-41f3-af7c-f644a83e60c2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.612210 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533706d-c70f-4885-a081-4b6c2f4d27ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.613740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533706d-c70f-4885-a081-4b6c2f4d27ce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.614192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533706d-c70f-4885-a081-4b6c2f4d27ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.614630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533706d-c70f-4885-a081-4b6c2f4d27ce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.622885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533706d-c70f-4885-a081-4b6c2f4d27ce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.625122 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533706d-c70f-4885-a081-4b6c2f4d27ce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.639391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-3533706d-c70f-4885-a081-4b6c2f4d27ce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:04.641317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 378/746] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:04.646625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405bcc0-2761-4e37-ba32-a235b3c26279 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.661295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405bcc0-2761-4e37-ba32-a235b3c26279 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.666639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3d049-6423-4cb6-ac17-aea4e239f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.667404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d049-6423-4cb6-ac17-aea4e239f563 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.667786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d049-6423-4cb6-ac17-aea4e239f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.668165 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3d049-6423-4cb6-ac17-aea4e239f563 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.669103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3d049-6423-4cb6-ac17-aea4e239f563 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:04.669470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3d049-6423-4cb6-ac17-aea4e239f563 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.671426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3d049-6423-4cb6-ac17-aea4e239f563 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.685506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 369/747] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:04.691268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533706d-c70f-4885-a081-4b6c2f4d27ce admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:04.702948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533706d-c70f-4885-a081-4b6c2f4d27ce admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:04.707621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b36501-0e8a-4b58-9a4d-015f7bf9b46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:04.708322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36501-0e8a-4b58-9a4d-015f7bf9b46b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:04.708631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36501-0e8a-4b58-9a4d-015f7bf9b46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:04.708901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36501-0e8a-4b58-9a4d-015f7bf9b46b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:04.709816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b36501-0e8a-4b58-9a4d-015f7bf9b46b admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=042a422ead5c48f1a428028abe9e419b) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:04.710126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b36501-0e8a-4b58-9a4d-015f7bf9b46b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:04.712061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b36501-0e8a-4b58-9a4d-015f7bf9b46b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:04.718352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 379/748] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:04 2022] GET /identity/v3/role_assignments?user.id=042a422ead5c48f1a428028abe9e419b&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:05.128865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d81857-2f3b-499d-a95a-2342da75ee05 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.129241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d81857-2f3b-499d-a95a-2342da75ee05 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.129432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d81857-2f3b-499d-a95a-2342da75ee05 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.131556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 370/749] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:05.136970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67c0fa-f904-489f-a67a-26dc151212ec None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.137257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67c0fa-f904-489f-a67a-26dc151212ec None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.137561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67c0fa-f904-489f-a67a-26dc151212ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.155240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4b67c0fa-f904-489f-a67a-26dc151212ec None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:05.156455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4b67c0fa-f904-489f-a67a-26dc151212ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:05.164956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 380/750] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:05 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:29:05.188182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d81857-2f3b-499d-a95a-2342da75ee05 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.204970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d81857-2f3b-499d-a95a-2342da75ee05 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.212926 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb131bab-a1b1-4f2e-bb13-f98927286c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.213588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb131bab-a1b1-4f2e-bb13-f98927286c55 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.213871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb131bab-a1b1-4f2e-bb13-f98927286c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.214150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb131bab-a1b1-4f2e-bb13-f98927286c55 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.214901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb131bab-a1b1-4f2e-bb13-f98927286c55 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.215921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-bb131bab-a1b1-4f2e-bb13-f98927286c55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:05.215921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:29:05.215921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:29:05.216828 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb131bab-a1b1-4f2e-bb13-f98927286c55 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.240705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 371/751] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:29:05 2022] POST /identity/v3/services => generated 240 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:05.326334 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd77946-e328-4459-8a44-edcf80f60eaa None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.326647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd77946-e328-4459-8a44-edcf80f60eaa None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.326871 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd77946-e328-4459-8a44-edcf80f60eaa None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.328962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 381/752] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:05.336884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6ef53-7999-4906-a718-9aac76b595d1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.337216 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6ef53-7999-4906-a718-9aac76b595d1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.337427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6ef53-7999-4906-a718-9aac76b595d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.361356 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f0d6ef53-7999-4906-a718-9aac76b595d1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:05.362550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f0d6ef53-7999-4906-a718-9aac76b595d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:05.384161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 372/753] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:05 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:05.420722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd77946-e328-4459-8a44-edcf80f60eaa None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.438568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd77946-e328-4459-8a44-edcf80f60eaa None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.449148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a8ebe-91a9-44ac-ba1f-5f39e3f9b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.449970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a8ebe-91a9-44ac-ba1f-5f39e3f9b450 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.450247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a8ebe-91a9-44ac-ba1f-5f39e3f9b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.450521 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a8ebe-91a9-44ac-ba1f-5f39e3f9b450 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.464661 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a8ebe-91a9-44ac-ba1f-5f39e3f9b450 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:05.471454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-311a8ebe-91a9-44ac-ba1f-5f39e3f9b450 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:05.472746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 382/754] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:05.479435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6ef53-7999-4906-a718-9aac76b595d1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.489989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6ef53-7999-4906-a718-9aac76b595d1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.496806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677dbf3-4220-4b49-a9b7-30604394f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.497476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677dbf3-4220-4b49-a9b7-30604394f138 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.497758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677dbf3-4220-4b49-a9b7-30604394f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.498034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677dbf3-4220-4b49-a9b7-30604394f138 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.498799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677dbf3-4220-4b49-a9b7-30604394f138 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:05.499102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677dbf3-4220-4b49-a9b7-30604394f138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.500735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677dbf3-4220-4b49-a9b7-30604394f138 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.510980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 373/755] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:05.516073 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a8ebe-91a9-44ac-ba1f-5f39e3f9b450 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.526809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a8ebe-91a9-44ac-ba1f-5f39e3f9b450 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.531567 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0893c9-ad1c-4bcb-889b-fa3a0fe72889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.532440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0893c9-ad1c-4bcb-889b-fa3a0fe72889 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.532721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0893c9-ad1c-4bcb-889b-fa3a0fe72889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.533048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0893c9-ad1c-4bcb-889b-fa3a0fe72889 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.544671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0893c9-ad1c-4bcb-889b-fa3a0fe72889 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.546581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0893c9-ad1c-4bcb-889b-fa3a0fe72889 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.564868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5b0893c9-ad1c-4bcb-889b-fa3a0fe72889 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:05.566395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 383/756] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:05.572049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677dbf3-4220-4b49-a9b7-30604394f138 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.582492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677dbf3-4220-4b49-a9b7-30604394f138 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.588859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d488311-7f42-4f78-a5b9-634b72ebab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.589506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d488311-7f42-4f78-a5b9-634b72ebab2d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.589785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d488311-7f42-4f78-a5b9-634b72ebab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.590058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d488311-7f42-4f78-a5b9-634b72ebab2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.590788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d488311-7f42-4f78-a5b9-634b72ebab2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:05.591093 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d488311-7f42-4f78-a5b9-634b72ebab2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.592739 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d488311-7f42-4f78-a5b9-634b72ebab2d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.605641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 374/757] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:05.611115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0893c9-ad1c-4bcb-889b-fa3a0fe72889 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.621823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0893c9-ad1c-4bcb-889b-fa3a0fe72889 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.632476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18c012-8a2c-461e-b3fc-eba83f275901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.633302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c012-8a2c-461e-b3fc-eba83f275901 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.633585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c012-8a2c-461e-b3fc-eba83f275901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.633855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18c012-8a2c-461e-b3fc-eba83f275901 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.645194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18c012-8a2c-461e-b3fc-eba83f275901 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.647215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18c012-8a2c-461e-b3fc-eba83f275901 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.661020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6a18c012-8a2c-461e-b3fc-eba83f275901 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 02:29:05.663083 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 384/758] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:05.668267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d488311-7f42-4f78-a5b9-634b72ebab2d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.684682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d488311-7f42-4f78-a5b9-634b72ebab2d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.689493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74898-a8ba-4d2b-b8b0-b83dd0c3a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.690159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74898-a8ba-4d2b-b8b0-b83dd0c3a180 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.690433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74898-a8ba-4d2b-b8b0-b83dd0c3a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.690703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74898-a8ba-4d2b-b8b0-b83dd0c3a180 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.691544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74898-a8ba-4d2b-b8b0-b83dd0c3a180 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:05.691846 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74898-a8ba-4d2b-b8b0-b83dd0c3a180 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.693750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74898-a8ba-4d2b-b8b0-b83dd0c3a180 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.711602 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 375/759] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:05.717042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18c012-8a2c-461e-b3fc-eba83f275901 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.731271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18c012-8a2c-461e-b3fc-eba83f275901 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.735943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8797f38-fe94-454d-abbe-99e339e533ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.736623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8797f38-fe94-454d-abbe-99e339e533ad admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.736951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8797f38-fe94-454d-abbe-99e339e533ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.737226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8797f38-fe94-454d-abbe-99e339e533ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.746262 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8797f38-fe94-454d-abbe-99e339e533ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.748077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8797f38-fe94-454d-abbe-99e339e533ad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.759900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 385/760] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:05.765253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74898-a8ba-4d2b-b8b0-b83dd0c3a180 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.775799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74898-a8ba-4d2b-b8b0-b83dd0c3a180 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.780615 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c788b-991f-46dc-918e-941a94177506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.781527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c788b-991f-46dc-918e-941a94177506 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.781877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c788b-991f-46dc-918e-941a94177506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.782270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c788b-991f-46dc-918e-941a94177506 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.793762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c788b-991f-46dc-918e-941a94177506 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.795721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c788b-991f-46dc-918e-941a94177506 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.813712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-396c788b-991f-46dc-918e-941a94177506 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:05.815346 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 376/761] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:05.820704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8797f38-fe94-454d-abbe-99e339e533ad admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.830834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8797f38-fe94-454d-abbe-99e339e533ad admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.841473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc74f8e-74af-4fae-8230-2f8be32633e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.842187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc74f8e-74af-4fae-8230-2f8be32633e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.842469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc74f8e-74af-4fae-8230-2f8be32633e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.842740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc74f8e-74af-4fae-8230-2f8be32633e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.843465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc74f8e-74af-4fae-8230-2f8be32633e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:05.843820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc74f8e-74af-4fae-8230-2f8be32633e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.845432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc74f8e-74af-4fae-8230-2f8be32633e5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.859773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 386/762] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:05.865306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c788b-991f-46dc-918e-941a94177506 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.878430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c788b-991f-46dc-918e-941a94177506 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.884054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766afcfd-b1e7-431f-88ce-ad8fa2c2b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.884924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766afcfd-b1e7-431f-88ce-ad8fa2c2b41e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.885203 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766afcfd-b1e7-431f-88ce-ad8fa2c2b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.885528 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766afcfd-b1e7-431f-88ce-ad8fa2c2b41e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.894365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766afcfd-b1e7-431f-88ce-ad8fa2c2b41e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.896445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766afcfd-b1e7-431f-88ce-ad8fa2c2b41e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.913195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-766afcfd-b1e7-431f-88ce-ad8fa2c2b41e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:05.914397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 377/763] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:05.920129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc74f8e-74af-4fae-8230-2f8be32633e5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.932677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc74f8e-74af-4fae-8230-2f8be32633e5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.938058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126cf8f-c371-4e9a-acc8-d846427c9a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.938766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126cf8f-c371-4e9a-acc8-d846427c9a2f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.939048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126cf8f-c371-4e9a-acc8-d846427c9a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.939323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126cf8f-c371-4e9a-acc8-d846427c9a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.940177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126cf8f-c371-4e9a-acc8-d846427c9a2f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:05.940520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126cf8f-c371-4e9a-acc8-d846427c9a2f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:05.942420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126cf8f-c371-4e9a-acc8-d846427c9a2f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:05.970481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 387/764] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:05.976901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766afcfd-b1e7-431f-88ce-ad8fa2c2b41e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:05.988703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766afcfd-b1e7-431f-88ce-ad8fa2c2b41e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:05.995675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807dd15-2cac-4bc5-b3a9-43c50012ea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:05.996412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807dd15-2cac-4bc5-b3a9-43c50012ea6a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:05.996701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807dd15-2cac-4bc5-b3a9-43c50012ea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:05.997019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807dd15-2cac-4bc5-b3a9-43c50012ea6a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:05.997868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807dd15-2cac-4bc5-b3a9-43c50012ea6a admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=2074fd021729416ea1c9b596d0bb892b) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:05.998220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807dd15-2cac-4bc5-b3a9-43c50012ea6a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:06.000129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807dd15-2cac-4bc5-b3a9-43c50012ea6a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:06.008146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 378/765] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:05 2022] GET /identity/v3/role_assignments?user.id=2074fd021729416ea1c9b596d0bb892b&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:06.819443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5ad53-b184-4475-b2e0-f8123ad3c0d6 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:06.820035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5ad53-b184-4475-b2e0-f8123ad3c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:06.820035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5ad53-b184-4475-b2e0-f8123ad3c0d6 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:06.822038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 388/766] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:06.839460 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf57a2-b4b9-4f4a-a222-3842f9dd923c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:06.840057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf57a2-b4b9-4f4a-a222-3842f9dd923c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:06.840327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf57a2-b4b9-4f4a-a222-3842f9dd923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:06.882564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-eddf57a2-b4b9-4f4a-a222-3842f9dd923c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:06.884567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-eddf57a2-b4b9-4f4a-a222-3842f9dd923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:06.895810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 379/767] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:06.948094 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5ad53-b184-4475-b2e0-f8123ad3c0d6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:06.968968 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5ad53-b184-4475-b2e0-f8123ad3c0d6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:06.976686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d2f30-178b-43a6-8bf5-f8bac7e5b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:06.977519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d2f30-178b-43a6-8bf5-f8bac7e5b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:06.977799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d2f30-178b-43a6-8bf5-f8bac7e5b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:06.978076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d2f30-178b-43a6-8bf5-f8bac7e5b4e4 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:06.978757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d2f30-178b-43a6-8bf5-f8bac7e5b4e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:06.980401 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d2f30-178b-43a6-8bf5-f8bac7e5b4e4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:06.994883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-899d2f30-178b-43a6-8bf5-f8bac7e5b4e4 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 07 02:29:06.996092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 389/768] 10.222.0.15 () {56 vars in 1150 bytes} [Mon Feb 7 02:29:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:07.002029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf57a2-b4b9-4f4a-a222-3842f9dd923c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.012257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf57a2-b4b9-4f4a-a222-3842f9dd923c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.025111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee02f-840a-4f13-b469-5d56541ac060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.026178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee02f-840a-4f13-b469-5d56541ac060 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.026613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee02f-840a-4f13-b469-5d56541ac060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.027048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ee02f-840a-4f13-b469-5d56541ac060 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.028144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee02f-840a-4f13-b469-5d56541ac060 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:07.028618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee02f-840a-4f13-b469-5d56541ac060 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.031010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ee02f-840a-4f13-b469-5d56541ac060 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.044847 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 380/769] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:07.052250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d2f30-178b-43a6-8bf5-f8bac7e5b4e4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.072379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d2f30-178b-43a6-8bf5-f8bac7e5b4e4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.080500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3667cb-08b9-49d8-9823-7e1df879a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.081166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3667cb-08b9-49d8-9823-7e1df879a6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.081449 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3667cb-08b9-49d8-9823-7e1df879a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.081724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3667cb-08b9-49d8-9823-7e1df879a6e5 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.082445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3667cb-08b9-49d8-9823-7e1df879a6e5 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:07.082752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3667cb-08b9-49d8-9823-7e1df879a6e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.084399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3667cb-08b9-49d8-9823-7e1df879a6e5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.096008 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 390/770] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:07.105098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee02f-840a-4f13-b469-5d56541ac060 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.119999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ee02f-840a-4f13-b469-5d56541ac060 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.126008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d969cbe-d40e-4275-8520-28f07b0aa995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.126918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d969cbe-d40e-4275-8520-28f07b0aa995 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.127315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d969cbe-d40e-4275-8520-28f07b0aa995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.127701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d969cbe-d40e-4275-8520-28f07b0aa995 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.128918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d969cbe-d40e-4275-8520-28f07b0aa995 admin admin] RBAC: Adding query filter params (interface=public, service_id=4f62c3c5791f46e3bb51a7e6802b843e, region_id=RegionOne) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:07.129373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d969cbe-d40e-4275-8520-28f07b0aa995 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.131392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-8d969cbe-d40e-4275-8520-28f07b0aa995 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:07.131392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:29:07.131392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:29:07.132727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d969cbe-d40e-4275-8520-28f07b0aa995 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.144241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 381/771] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/endpoints?service_id=4f62c3c5791f46e3bb51a7e6802b843e&interface=public®ion_id=RegionOne => generated 194 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:07.153062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3667cb-08b9-49d8-9823-7e1df879a6e5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.169298 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3667cb-08b9-49d8-9823-7e1df879a6e5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.177941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559add1-68c1-4c00-ab40-f0e2fda8d548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.178686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559add1-68c1-4c00-ab40-f0e2fda8d548 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.178967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559add1-68c1-4c00-ab40-f0e2fda8d548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.179238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559add1-68c1-4c00-ab40-f0e2fda8d548 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.179934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559add1-68c1-4c00-ab40-f0e2fda8d548 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.181556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559add1-68c1-4c00-ab40-f0e2fda8d548 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.194044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 391/772] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/services => generated 772 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:07.417154 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f2667-c665-4f69-a546-47bf130bee85 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.417540 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f2667-c665-4f69-a546-47bf130bee85 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.417793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f2667-c665-4f69-a546-47bf130bee85 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.419493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 382/773] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:07.438183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22776357-1e74-483e-88e7-8040530606a0 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.438498 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22776357-1e74-483e-88e7-8040530606a0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.438734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22776357-1e74-483e-88e7-8040530606a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.460859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-22776357-1e74-483e-88e7-8040530606a0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:07.462055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-22776357-1e74-483e-88e7-8040530606a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:07.474820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 392/774] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:07 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:07.493986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a109c2-9f4d-497e-a8c2-7573dae12450 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.494382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a109c2-9f4d-497e-a8c2-7573dae12450 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.494769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a109c2-9f4d-497e-a8c2-7573dae12450 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.497486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 383/775] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:07.503755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e171670-d65c-41c7-844f-2254a149a7cb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.504150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e171670-d65c-41c7-844f-2254a149a7cb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.504619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e171670-d65c-41c7-844f-2254a149a7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.527660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7e171670-d65c-41c7-844f-2254a149a7cb None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:07.528870 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7e171670-d65c-41c7-844f-2254a149a7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:07.536507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a109c2-9f4d-497e-a8c2-7573dae12450 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.550245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 393/776] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:07 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:07.554031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a109c2-9f4d-497e-a8c2-7573dae12450 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.558464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aad028-444b-45ec-96e3-92ac9702af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.559475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad028-444b-45ec-96e3-92ac9702af60 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.559874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad028-444b-45ec-96e3-92ac9702af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.560261 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad028-444b-45ec-96e3-92ac9702af60 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.577945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e171670-d65c-41c7-844f-2254a149a7cb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.587705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aad028-444b-45ec-96e3-92ac9702af60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:07.587705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-08aad028-444b-45ec-96e3-92ac9702af60 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:29:07.588332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 384/777] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:07.590388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e171670-d65c-41c7-844f-2254a149a7cb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.594495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aad028-444b-45ec-96e3-92ac9702af60 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.596540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71217e7-1181-48b8-906c-cee22f727c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.597721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71217e7-1181-48b8-906c-cee22f727c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.598175 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71217e7-1181-48b8-906c-cee22f727c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.598610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71217e7-1181-48b8-906c-cee22f727c95 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.605645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aad028-444b-45ec-96e3-92ac9702af60 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.612919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71217e7-1181-48b8-906c-cee22f727c95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:07.617628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885265a-bfbb-43e4-86d2-c0c4f5b65a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.618586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885265a-bfbb-43e4-86d2-c0c4f5b65a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.619071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885265a-bfbb-43e4-86d2-c0c4f5b65a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.619535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885265a-bfbb-43e4-86d2-c0c4f5b65a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.620388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a71217e7-1181-48b8-906c-cee22f727c95 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:07.620743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885265a-bfbb-43e4-86d2-c0c4f5b65a03 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:07.621416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885265a-bfbb-43e4-86d2-c0c4f5b65a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.621878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 394/778] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:07.627932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885265a-bfbb-43e4-86d2-c0c4f5b65a03 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.630282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71217e7-1181-48b8-906c-cee22f727c95 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.642204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 385/779] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:07.648297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885265a-bfbb-43e4-86d2-c0c4f5b65a03 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.648478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71217e7-1181-48b8-906c-cee22f727c95 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.656662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b138a-a14f-4b33-9ce2-a765073b4c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.657340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b138a-a14f-4b33-9ce2-a765073b4c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.657885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b138a-a14f-4b33-9ce2-a765073b4c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.658165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b138a-a14f-4b33-9ce2-a765073b4c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.658936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b138a-a14f-4b33-9ce2-a765073b4c5c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:07.659239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b138a-a14f-4b33-9ce2-a765073b4c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.660847 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885265a-bfbb-43e4-86d2-c0c4f5b65a03 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.660981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b138a-a14f-4b33-9ce2-a765073b4c5c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.668109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a9964-3aec-4056-8c9f-f2114e87f8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.669215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a9964-3aec-4056-8c9f-f2114e87f8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.669745 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a9964-3aec-4056-8c9f-f2114e87f8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.670226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a9964-3aec-4056-8c9f-f2114e87f8d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.676378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 395/780] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:07.683199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a9964-3aec-4056-8c9f-f2114e87f8d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.685957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b138a-a14f-4b33-9ce2-a765073b4c5c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.698515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a9964-3aec-4056-8c9f-f2114e87f8d0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.713930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b138a-a14f-4b33-9ce2-a765073b4c5c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.723239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f1d37-1d2e-4080-a5d8-cba814bfe890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.726179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f1d37-1d2e-4080-a5d8-cba814bfe890 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.728245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f1d37-1d2e-4080-a5d8-cba814bfe890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.728579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f1d37-1d2e-4080-a5d8-cba814bfe890 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.753534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-eb5a9964-3aec-4056-8c9f-f2114e87f8d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:07.754839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 386/781] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:07.756011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f1d37-1d2e-4080-a5d8-cba814bfe890 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.758007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f1d37-1d2e-4080-a5d8-cba814bfe890 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.761060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a9964-3aec-4056-8c9f-f2114e87f8d0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.782490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a9964-3aec-4056-8c9f-f2114e87f8d0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.795968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18e8ff-f850-4253-a5e1-14f1bc8a123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.798110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e8ff-f850-4253-a5e1-14f1bc8a123a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.798503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e8ff-f850-4253-a5e1-14f1bc8a123a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.800318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18e8ff-f850-4253-a5e1-14f1bc8a123a admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.801397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18e8ff-f850-4253-a5e1-14f1bc8a123a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:07.803593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18e8ff-f850-4253-a5e1-14f1bc8a123a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.806199 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5a2f1d37-1d2e-4080-a5d8-cba814bfe890 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:07.808207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18e8ff-f850-4253-a5e1-14f1bc8a123a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.810337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 396/782] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:07.816110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f1d37-1d2e-4080-a5d8-cba814bfe890 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.841653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f1d37-1d2e-4080-a5d8-cba814bfe890 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.848786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 387/783] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:07.854855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18e8ff-f850-4253-a5e1-14f1bc8a123a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.856049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48e35e-662c-41f7-8465-0b4b28707bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.860403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48e35e-662c-41f7-8465-0b4b28707bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.860806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48e35e-662c-41f7-8465-0b4b28707bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.861193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48e35e-662c-41f7-8465-0b4b28707bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.864060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48e35e-662c-41f7-8465-0b4b28707bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:07.864533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48e35e-662c-41f7-8465-0b4b28707bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.870239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba48e35e-662c-41f7-8465-0b4b28707bbf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.877392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18e8ff-f850-4253-a5e1-14f1bc8a123a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.892634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7a478-2bbd-4c52-8d9a-b0196481977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.893824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7a478-2bbd-4c52-8d9a-b0196481977c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.894218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7a478-2bbd-4c52-8d9a-b0196481977c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.894665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7a478-2bbd-4c52-8d9a-b0196481977c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.902416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 397/784] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:07.907584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48e35e-662c-41f7-8465-0b4b28707bbf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.909619 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7a478-2bbd-4c52-8d9a-b0196481977c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.911635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7a478-2bbd-4c52-8d9a-b0196481977c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.921663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48e35e-662c-41f7-8465-0b4b28707bbf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.926701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae3bc7-0bc1-4fd2-9646-bf2ed57627a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.927781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae3bc7-0bc1-4fd2-9646-bf2ed57627a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.928251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae3bc7-0bc1-4fd2-9646-bf2ed57627a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.928815 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae3bc7-0bc1-4fd2-9646-bf2ed57627a9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.937266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae3bc7-0bc1-4fd2-9646-bf2ed57627a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.939587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae3bc7-0bc1-4fd2-9646-bf2ed57627a9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.939792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a1b7a478-2bbd-4c52-8d9a-b0196481977c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 02:29:07.948364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 388/785] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:07.949593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7a478-2bbd-4c52-8d9a-b0196481977c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.963559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-73ae3bc7-0bc1-4fd2-9646-bf2ed57627a9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 02:29:07.966363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7a478-2bbd-4c52-8d9a-b0196481977c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:07.967955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 398/786] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:07.971693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ca6fa-4253-400b-9d75-5a05903154cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:07.972415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca6fa-4253-400b-9d75-5a05903154cd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:07.972775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca6fa-4253-400b-9d75-5a05903154cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:07.973104 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca6fa-4253-400b-9d75-5a05903154cd admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:07.973921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ca6fa-4253-400b-9d75-5a05903154cd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:07.974226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ca6fa-4253-400b-9d75-5a05903154cd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:07.975239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae3bc7-0bc1-4fd2-9646-bf2ed57627a9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:07.980101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ca6fa-4253-400b-9d75-5a05903154cd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:07.990517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae3bc7-0bc1-4fd2-9646-bf2ed57627a9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.004259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd6f6f-d3b5-49c3-be29-743556d5295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.004939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd6f6f-d3b5-49c3-be29-743556d5295c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.005275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd6f6f-d3b5-49c3-be29-743556d5295c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.005551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd6f6f-d3b5-49c3-be29-743556d5295c admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.007905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd6f6f-d3b5-49c3-be29-743556d5295c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:08.008312 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd6f6f-d3b5-49c3-be29-743556d5295c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.010622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd6f6f-d3b5-49c3-be29-743556d5295c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.015024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 389/787] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:08.020186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ca6fa-4253-400b-9d75-5a05903154cd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.038308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ca6fa-4253-400b-9d75-5a05903154cd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.048117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 399/788] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Feb 7 02:29:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:08.050163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7dabc-06e1-4750-ba1e-94f22ee1b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.051025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7dabc-06e1-4750-ba1e-94f22ee1b86e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.051349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7dabc-06e1-4750-ba1e-94f22ee1b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.051623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7dabc-06e1-4750-ba1e-94f22ee1b86e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.054837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd6f6f-d3b5-49c3-be29-743556d5295c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.071252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd6f6f-d3b5-49c3-be29-743556d5295c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.071820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7dabc-06e1-4750-ba1e-94f22ee1b86e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.073792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7dabc-06e1-4750-ba1e-94f22ee1b86e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.088203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314311a2-9632-4498-8e51-476a3838cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.090146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314311a2-9632-4498-8e51-476a3838cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.090423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314311a2-9632-4498-8e51-476a3838cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.090697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314311a2-9632-4498-8e51-476a3838cd2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.101217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b3d7dabc-06e1-4750-ba1e-94f22ee1b86e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:08.104895 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 390/789] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:08.105849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314311a2-9632-4498-8e51-476a3838cd2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.107671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314311a2-9632-4498-8e51-476a3838cd2d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.109475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7dabc-06e1-4750-ba1e-94f22ee1b86e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.122193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7dabc-06e1-4750-ba1e-94f22ee1b86e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.127008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170cf1e-fbde-4c6b-9796-ce991a8e713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.127644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170cf1e-fbde-4c6b-9796-ce991a8e713e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.127975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170cf1e-fbde-4c6b-9796-ce991a8e713e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.128259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170cf1e-fbde-4c6b-9796-ce991a8e713e admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.129024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170cf1e-fbde-4c6b-9796-ce991a8e713e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:08.129377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170cf1e-fbde-4c6b-9796-ce991a8e713e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.131569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170cf1e-fbde-4c6b-9796-ce991a8e713e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.131852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 400/790] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:08.137289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314311a2-9632-4498-8e51-476a3838cd2d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.143717 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 391/791] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:08.149491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170cf1e-fbde-4c6b-9796-ce991a8e713e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.151393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314311a2-9632-4498-8e51-476a3838cd2d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.159406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170cf1e-fbde-4c6b-9796-ce991a8e713e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.164537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c73f-8331-4d41-a378-7139675d5edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.166855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa7b1f-bfe9-4378-911e-c0b9fc9356b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.167062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c73f-8331-4d41-a378-7139675d5edd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.167426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c73f-8331-4d41-a378-7139675d5edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.167707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c73f-8331-4d41-a378-7139675d5edd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.169018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa7b1f-bfe9-4378-911e-c0b9fc9356b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.169292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa7b1f-bfe9-4378-911e-c0b9fc9356b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.169795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa7b1f-bfe9-4378-911e-c0b9fc9356b7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.187408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa7b1f-bfe9-4378-911e-c0b9fc9356b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.189312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa7b1f-bfe9-4378-911e-c0b9fc9356b7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.190844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198c73f-8331-4d41-a378-7139675d5edd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.192751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198c73f-8331-4d41-a378-7139675d5edd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.216579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-92fa7b1f-bfe9-4378-911e-c0b9fc9356b7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:08.225859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 392/792] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:08.226549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1198c73f-8331-4d41-a378-7139675d5edd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:08.228020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 401/793] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:08.233442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa7b1f-bfe9-4378-911e-c0b9fc9356b7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.237688 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c73f-8331-4d41-a378-7139675d5edd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.252967 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa7b1f-bfe9-4378-911e-c0b9fc9356b7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.259569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c73f-8331-4d41-a378-7139675d5edd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.264511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab6dc2-b5e6-4aa2-b3be-5ad3be4fdd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.265908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab6dc2-b5e6-4aa2-b3be-5ad3be4fdd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.266801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab6dc2-b5e6-4aa2-b3be-5ad3be4fdd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.267603 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab6dc2-b5e6-4aa2-b3be-5ad3be4fdd54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.269109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab6dc2-b5e6-4aa2-b3be-5ad3be4fdd54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:08.269854 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda6c71-b805-42f6-80d1-c7979def0f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.270720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6c71-b805-42f6-80d1-c7979def0f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.271218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab6dc2-b5e6-4aa2-b3be-5ad3be4fdd54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.273088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab6dc2-b5e6-4aa2-b3be-5ad3be4fdd54 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.273584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6c71-b805-42f6-80d1-c7979def0f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.274058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6c71-b805-42f6-80d1-c7979def0f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.275054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6c71-b805-42f6-80d1-c7979def0f22 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:08.275557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6c71-b805-42f6-80d1-c7979def0f22 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.279117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6c71-b805-42f6-80d1-c7979def0f22 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.297505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 393/794] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:08.305542 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab6dc2-b5e6-4aa2-b3be-5ad3be4fdd54 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.306258 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 402/795] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:08.316133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda6c71-b805-42f6-80d1-c7979def0f22 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.326909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab6dc2-b5e6-4aa2-b3be-5ad3be4fdd54 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.332314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda6c71-b805-42f6-80d1-c7979def0f22 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.338048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618c27a-2fbd-4219-8a12-e581a209237e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.339064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618c27a-2fbd-4219-8a12-e581a209237e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.339539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618c27a-2fbd-4219-8a12-e581a209237e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.340459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618c27a-2fbd-4219-8a12-e581a209237e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.343866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0488b-9ebf-4913-bcbb-356f2bb8142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.344992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0488b-9ebf-4913-bcbb-356f2bb8142e admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.346215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0488b-9ebf-4913-bcbb-356f2bb8142e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.350139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0488b-9ebf-4913-bcbb-356f2bb8142e admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/042a422ead5c48f1a428028abe9e419b/roles/252e58e0307c43339c5bc8a0d299fea2` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.352401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618c27a-2fbd-4219-8a12-e581a209237e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.354742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618c27a-2fbd-4219-8a12-e581a209237e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.380191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e618c27a-2fbd-4219-8a12-e581a209237e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:08.383226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0488b-9ebf-4913-bcbb-356f2bb8142e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=042a422ead5c48f1a428028abe9e419b, role_id=252e58e0307c43339c5bc8a0d299fea2)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.386139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0488b-9ebf-4913-bcbb-356f2bb8142e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.389880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 394/796] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:08.396089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb9c4f-2c44-49f4-a5b2-454d04d624b5 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.396089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb9c4f-2c44-49f4-a5b2-454d04d624b5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.396089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb9c4f-2c44-49f4-a5b2-454d04d624b5 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.397408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 395/797] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:08.398377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb9c4f-2c44-49f4-a5b2-454d04d624b5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.407185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 403/798] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:29:08 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/042a422ead5c48f1a428028abe9e419b/roles/252e58e0307c43339c5bc8a0d299fea2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:29:08.408737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1f9ea-f919-49aa-a7b9-6ccfa3cc7799 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.409192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1f9ea-f919-49aa-a7b9-6ccfa3cc7799 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.409628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1f9ea-f919-49aa-a7b9-6ccfa3cc7799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.428577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-61a1f9ea-f919-49aa-a7b9-6ccfa3cc7799 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:08.430057 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-61a1f9ea-f919-49aa-a7b9-6ccfa3cc7799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:08.486712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb9c4f-2c44-49f4-a5b2-454d04d624b5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.492214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ba246-ce53-410c-8fa2-af875a324ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.493199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ba246-ce53-410c-8fa2-af875a324ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.493634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ba246-ce53-410c-8fa2-af875a324ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.494072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ba246-ce53-410c-8fa2-af875a324ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.494766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 404/799] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:08 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:08.498641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ba246-ce53-410c-8fa2-af875a324ba3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:08.498641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ba246-ce53-410c-8fa2-af875a324ba3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.499941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ba246-ce53-410c-8fa2-af875a324ba3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.517101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 396/800] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:08.523692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1f9ea-f919-49aa-a7b9-6ccfa3cc7799 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.531008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ba246-ce53-410c-8fa2-af875a324ba3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.535819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1f9ea-f919-49aa-a7b9-6ccfa3cc7799 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.542178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793afc4-d43e-49c4-9a29-acefe8b6730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.543180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793afc4-d43e-49c4-9a29-acefe8b6730c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.543651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793afc4-d43e-49c4-9a29-acefe8b6730c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.544127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793afc4-d43e-49c4-9a29-acefe8b6730c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.545199 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793afc4-d43e-49c4-9a29-acefe8b6730c admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=904a4e5f54e642eda58c90930b5858f4) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:08.545730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793afc4-d43e-49c4-9a29-acefe8b6730c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.547562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ba246-ce53-410c-8fa2-af875a324ba3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.548058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793afc4-d43e-49c4-9a29-acefe8b6730c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.556051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 405/801] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/role_assignments?user.id=904a4e5f54e642eda58c90930b5858f4&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:08.571957 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c7d2-333c-4ab1-9862-f44b7878fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.572816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c7d2-333c-4ab1-9862-f44b7878fae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.573153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c7d2-333c-4ab1-9862-f44b7878fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.573426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c7d2-333c-4ab1-9862-f44b7878fae2 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.574117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c7d2-333c-4ab1-9862-f44b7878fae2 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.576172 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52c7d2-333c-4ab1-9862-f44b7878fae2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.607456 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-4f52c7d2-333c-4ab1-9862-f44b7878fae2 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 07 02:29:08.609536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 397/802] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/services/network => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:08.616606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793afc4-d43e-49c4-9a29-acefe8b6730c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.635693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793afc4-d43e-49c4-9a29-acefe8b6730c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.651583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8452b2-76ff-4d6e-90f1-12244c5963f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.652569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8452b2-76ff-4d6e-90f1-12244c5963f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.652971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8452b2-76ff-4d6e-90f1-12244c5963f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.653359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8452b2-76ff-4d6e-90f1-12244c5963f1 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.654424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8452b2-76ff-4d6e-90f1-12244c5963f1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:08.654859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8452b2-76ff-4d6e-90f1-12244c5963f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.657379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8452b2-76ff-4d6e-90f1-12244c5963f1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.665746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 406/803] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:08.671802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c7d2-333c-4ab1-9862-f44b7878fae2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.686127 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c7d2-333c-4ab1-9862-f44b7878fae2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.691129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b587-2863-428f-9dd2-38d34a0d311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.692107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b587-2863-428f-9dd2-38d34a0d311e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.692627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b587-2863-428f-9dd2-38d34a0d311e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.693097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b587-2863-428f-9dd2-38d34a0d311e admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.694129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065b587-2863-428f-9dd2-38d34a0d311e admin admin] RBAC: Adding query filter params (type=network) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:08.694684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065b587-2863-428f-9dd2-38d34a0d311e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.696620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065b587-2863-428f-9dd2-38d34a0d311e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.703291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 398/804] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:08.709346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8452b2-76ff-4d6e-90f1-12244c5963f1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.720198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8452b2-76ff-4d6e-90f1-12244c5963f1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.726233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61d428-4f56-4823-8c2a-79f40a2db6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.727298 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61d428-4f56-4823-8c2a-79f40a2db6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.727780 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61d428-4f56-4823-8c2a-79f40a2db6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.728309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61d428-4f56-4823-8c2a-79f40a2db6d0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.729424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61d428-4f56-4823-8c2a-79f40a2db6d0 admin admin] RBAC: Adding query filter params (interface=public, service_id=80b11062481d4e348ef707b41cef3c31, region_id=RegionOne) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:08.729959 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61d428-4f56-4823-8c2a-79f40a2db6d0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.731283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-1a61d428-4f56-4823-8c2a-79f40a2db6d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:08.731283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:29:08.731283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:29:08.732531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61d428-4f56-4823-8c2a-79f40a2db6d0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.744362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 407/805] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/endpoints?service_id=80b11062481d4e348ef707b41cef3c31&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:08.750632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b587-2863-428f-9dd2-38d34a0d311e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.766780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b587-2863-428f-9dd2-38d34a0d311e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.771884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88521a91-6ff8-4763-9b2b-68223ed7ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.772881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88521a91-6ff8-4763-9b2b-68223ed7ce5f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.773379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88521a91-6ff8-4763-9b2b-68223ed7ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.773869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88521a91-6ff8-4763-9b2b-68223ed7ce5f admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.774842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88521a91-6ff8-4763-9b2b-68223ed7ce5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:08.776728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88521a91-6ff8-4763-9b2b-68223ed7ce5f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:08.783107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 399/806] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/services => generated 772 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:08.911909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465cb14-4147-424d-a2c4-820f20f53350 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.913016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465cb14-4147-424d-a2c4-820f20f53350 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.913016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465cb14-4147-424d-a2c4-820f20f53350 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.915169 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 408/807] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:08.921185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69bd2-378d-47be-8b0f-27aa7c44d282 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.921672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69bd2-378d-47be-8b0f-27aa7c44d282 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.921770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69bd2-378d-47be-8b0f-27aa7c44d282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:08.941572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-54c69bd2-378d-47be-8b0f-27aa7c44d282 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:08.942780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-54c69bd2-378d-47be-8b0f-27aa7c44d282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:08.951469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 400/808] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:08 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:08.976734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465cb14-4147-424d-a2c4-820f20f53350 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:08.989938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465cb14-4147-424d-a2c4-820f20f53350 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:08.994563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f14cd-e4df-44f5-ba73-f458cd304174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:08.995364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f14cd-e4df-44f5-ba73-f458cd304174 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:08.995642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f14cd-e4df-44f5-ba73-f458cd304174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:08.995916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f14cd-e4df-44f5-ba73-f458cd304174 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.008664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f14cd-e4df-44f5-ba73-f458cd304174 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:09.015745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-f79f14cd-e4df-44f5-ba73-f458cd304174 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:09.017289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 409/809] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:09.023542 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c69bd2-378d-47be-8b0f-27aa7c44d282 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.033701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c69bd2-378d-47be-8b0f-27aa7c44d282 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.039648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f145e-397e-48e0-9f1c-c2e79b4222f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.040326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f145e-397e-48e0-9f1c-c2e79b4222f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.040634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f145e-397e-48e0-9f1c-c2e79b4222f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.040955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f145e-397e-48e0-9f1c-c2e79b4222f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.041842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f145e-397e-48e0-9f1c-c2e79b4222f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:09.042147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f145e-397e-48e0-9f1c-c2e79b4222f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.043751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f145e-397e-48e0-9f1c-c2e79b4222f7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.053512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 401/810] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:09.059054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f14cd-e4df-44f5-ba73-f458cd304174 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.070346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f14cd-e4df-44f5-ba73-f458cd304174 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.077874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1672a0-becd-4901-b150-0c8d9aa0bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.078735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1672a0-becd-4901-b150-0c8d9aa0bd2b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.079017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1672a0-becd-4901-b150-0c8d9aa0bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.079292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1672a0-becd-4901-b150-0c8d9aa0bd2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.093823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1672a0-becd-4901-b150-0c8d9aa0bd2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.095700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1672a0-becd-4901-b150-0c8d9aa0bd2b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.114089 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-dd1672a0-becd-4901-b150-0c8d9aa0bd2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:09.115744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 410/811] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:09.121379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f145e-397e-48e0-9f1c-c2e79b4222f7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.131282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f145e-397e-48e0-9f1c-c2e79b4222f7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.135756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18dadf-c464-4adc-b25c-1709e4a287df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.136494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18dadf-c464-4adc-b25c-1709e4a287df admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.136797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18dadf-c464-4adc-b25c-1709e4a287df admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.137106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18dadf-c464-4adc-b25c-1709e4a287df admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.137844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18dadf-c464-4adc-b25c-1709e4a287df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:09.138193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18dadf-c464-4adc-b25c-1709e4a287df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.139845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18dadf-c464-4adc-b25c-1709e4a287df admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.152915 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 402/812] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:09.158498 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1672a0-becd-4901-b150-0c8d9aa0bd2b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.169905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1672a0-becd-4901-b150-0c8d9aa0bd2b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.174572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c62560-ca16-44cf-884a-4d0f8ea8ac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.175417 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c62560-ca16-44cf-884a-4d0f8ea8ac3c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.175697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c62560-ca16-44cf-884a-4d0f8ea8ac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.176028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c62560-ca16-44cf-884a-4d0f8ea8ac3c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.184990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c62560-ca16-44cf-884a-4d0f8ea8ac3c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.187102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c62560-ca16-44cf-884a-4d0f8ea8ac3c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.201955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-83c62560-ca16-44cf-884a-4d0f8ea8ac3c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 02:29:09.203430 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 411/813] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:09.209615 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18dadf-c464-4adc-b25c-1709e4a287df admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.219693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18dadf-c464-4adc-b25c-1709e4a287df admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.224451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8a2ef-7103-44bb-a765-0463231cff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.225731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8a2ef-7103-44bb-a765-0463231cff23 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.226011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8a2ef-7103-44bb-a765-0463231cff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.226286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8a2ef-7103-44bb-a765-0463231cff23 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.227128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8a2ef-7103-44bb-a765-0463231cff23 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:09.227482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8a2ef-7103-44bb-a765-0463231cff23 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.229425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8a2ef-7103-44bb-a765-0463231cff23 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.254599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 403/814] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Feb 7 02:29:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:09.260030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c62560-ca16-44cf-884a-4d0f8ea8ac3c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.270387 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c62560-ca16-44cf-884a-4d0f8ea8ac3c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.275549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7591cae-605a-4a63-bc85-6ce9cf82f61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.276416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591cae-605a-4a63-bc85-6ce9cf82f61f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.276705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591cae-605a-4a63-bc85-6ce9cf82f61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.276979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7591cae-605a-4a63-bc85-6ce9cf82f61f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.288839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7591cae-605a-4a63-bc85-6ce9cf82f61f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.290799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7591cae-605a-4a63-bc85-6ce9cf82f61f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.319010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b7591cae-605a-4a63-bc85-6ce9cf82f61f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:09.324777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 412/815] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:09.326688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8a2ef-7103-44bb-a765-0463231cff23 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.337663 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8a2ef-7103-44bb-a765-0463231cff23 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.342330 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b27e7-0e54-47e3-9a38-046b05ba0d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.343002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b27e7-0e54-47e3-9a38-046b05ba0d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.343283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b27e7-0e54-47e3-9a38-046b05ba0d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.343558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b27e7-0e54-47e3-9a38-046b05ba0d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.344371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b27e7-0e54-47e3-9a38-046b05ba0d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:09.344703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b27e7-0e54-47e3-9a38-046b05ba0d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.346450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b27e7-0e54-47e3-9a38-046b05ba0d4b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.359142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 404/816] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:09.364683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7591cae-605a-4a63-bc85-6ce9cf82f61f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.374956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7591cae-605a-4a63-bc85-6ce9cf82f61f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.379914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3327d-fad7-4ede-83e5-8f910bfab673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.381438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3327d-fad7-4ede-83e5-8f910bfab673 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.381717 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3327d-fad7-4ede-83e5-8f910bfab673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.381994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3327d-fad7-4ede-83e5-8f910bfab673 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.389580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3327d-fad7-4ede-83e5-8f910bfab673 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.391594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3327d-fad7-4ede-83e5-8f910bfab673 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.406554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a7e3327d-fad7-4ede-83e5-8f910bfab673 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:09.408155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 413/817] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:09.414288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b27e7-0e54-47e3-9a38-046b05ba0d4b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.426729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b27e7-0e54-47e3-9a38-046b05ba0d4b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.431968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe402ff4-fe01-43e4-8791-1f1eb1903dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.433062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402ff4-fe01-43e4-8791-1f1eb1903dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.433627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402ff4-fe01-43e4-8791-1f1eb1903dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.434131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe402ff4-fe01-43e4-8791-1f1eb1903dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.435665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402ff4-fe01-43e4-8791-1f1eb1903dfb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:09.435982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402ff4-fe01-43e4-8791-1f1eb1903dfb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.437958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe402ff4-fe01-43e4-8791-1f1eb1903dfb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.453152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 405/818] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:09.461063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3327d-fad7-4ede-83e5-8f910bfab673 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:09.471917 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3327d-fad7-4ede-83e5-8f910bfab673 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:09.479472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb29bd-e553-40c3-b32f-ce7fc1ff55e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:09.480501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb29bd-e553-40c3-b32f-ce7fc1ff55e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:09.480895 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb29bd-e553-40c3-b32f-ce7fc1ff55e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:09.481237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb29bd-e553-40c3-b32f-ce7fc1ff55e6 admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/2074fd021729416ea1c9b596d0bb892b/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:09.483364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb29bd-e553-40c3-b32f-ce7fc1ff55e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=2074fd021729416ea1c9b596d0bb892b, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:09.486213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb29bd-e553-40c3-b32f-ce7fc1ff55e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:09.502962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 414/819] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:29:09 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/2074fd021729416ea1c9b596d0bb892b/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:29:10.405865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcafe6-f376-4339-903b-e003b3eb7d2e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:10.406892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcafe6-f376-4339-903b-e003b3eb7d2e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:10.407378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcafe6-f376-4339-903b-e003b3eb7d2e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:10.409654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 406/820] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:29:10.415160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae5106-3b87-4e01-b7db-7e00e91f4edc None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:10.415980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae5106-3b87-4e01-b7db-7e00e91f4edc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:10.416471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae5106-3b87-4e01-b7db-7e00e91f4edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:10.438048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-59ae5106-3b87-4e01-b7db-7e00e91f4edc None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:10.439497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-59ae5106-3b87-4e01-b7db-7e00e91f4edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:10.497887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 415/821] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:10 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:10.540632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcafe6-f376-4339-903b-e003b3eb7d2e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:10.554349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcafe6-f376-4339-903b-e003b3eb7d2e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:10.564358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9de41e-db5c-4471-862f-e2f74fc2c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:10.565166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9de41e-db5c-4471-862f-e2f74fc2c47a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:10.565444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9de41e-db5c-4471-862f-e2f74fc2c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:10.565712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9de41e-db5c-4471-862f-e2f74fc2c47a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:10.566373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9de41e-db5c-4471-862f-e2f74fc2c47a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:10.567963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9de41e-db5c-4471-862f-e2f74fc2c47a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:10.584462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2c9de41e-db5c-4471-862f-e2f74fc2c47a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 07 02:29:10.585974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 407/822] 10.222.0.15 () {56 vars in 1150 bytes} [Mon Feb 7 02:29:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:10.591576 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae5106-3b87-4e01-b7db-7e00e91f4edc None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:10.605207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae5106-3b87-4e01-b7db-7e00e91f4edc None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:10.612969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7d70e-43d2-48b5-8d71-c0a27e5953fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:10.613889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d70e-43d2-48b5-8d71-c0a27e5953fa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:10.614369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d70e-43d2-48b5-8d71-c0a27e5953fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:10.614892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d70e-43d2-48b5-8d71-c0a27e5953fa admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:10.615897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7d70e-43d2-48b5-8d71-c0a27e5953fa admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:10.616417 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7d70e-43d2-48b5-8d71-c0a27e5953fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:10.618197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7d70e-43d2-48b5-8d71-c0a27e5953fa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:10.623232 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 416/823] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Feb 7 02:29:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:10.628779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9de41e-db5c-4471-862f-e2f74fc2c47a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:10.645418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9de41e-db5c-4471-862f-e2f74fc2c47a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:10.657038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5f4c1-063a-422f-8d1d-f33d07f434c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:10.657653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5f4c1-063a-422f-8d1d-f33d07f434c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:10.657939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5f4c1-063a-422f-8d1d-f33d07f434c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:10.658217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5f4c1-063a-422f-8d1d-f33d07f434c7 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:10.658944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5f4c1-063a-422f-8d1d-f33d07f434c7 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:10.659252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5f4c1-063a-422f-8d1d-f33d07f434c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:10.660882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5f4c1-063a-422f-8d1d-f33d07f434c7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:10.667116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 408/824] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Feb 7 02:29:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:10.672903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7d70e-43d2-48b5-8d71-c0a27e5953fa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:10.687359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7d70e-43d2-48b5-8d71-c0a27e5953fa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:10.692427 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc310f-3087-4930-8ac3-8924321fec69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:10.693967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc310f-3087-4930-8ac3-8924321fec69 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:10.694502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc310f-3087-4930-8ac3-8924321fec69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:10.694988 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc310f-3087-4930-8ac3-8924321fec69 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:10.696519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc310f-3087-4930-8ac3-8924321fec69 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:10.697797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-8cbc310f-3087-4930-8ac3-8924321fec69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:10.697797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:29:10.697797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:29:10.699046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc310f-3087-4930-8ac3-8924321fec69 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:10.729156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 417/825] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Feb 7 02:29:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:11.303587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73896608-b7f4-48af-b581-03d0b37815a2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.304281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73896608-b7f4-48af-b581-03d0b37815a2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.304795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73896608-b7f4-48af-b581-03d0b37815a2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.306998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 409/826] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:11.313349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293918b-9e30-41e7-87b1-30042eaba52c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.313901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293918b-9e30-41e7-87b1-30042eaba52c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.314371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293918b-9e30-41e7-87b1-30042eaba52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.332643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f293918b-9e30-41e7-87b1-30042eaba52c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:11.334700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f293918b-9e30-41e7-87b1-30042eaba52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:11.355677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 418/827] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:11 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:11.383254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73896608-b7f4-48af-b581-03d0b37815a2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.396111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73896608-b7f4-48af-b581-03d0b37815a2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.404948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24288baf-025c-42ae-bf12-6b1a8756fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.405744 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24288baf-025c-42ae-bf12-6b1a8756fc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.406024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24288baf-025c-42ae-bf12-6b1a8756fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.406533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24288baf-025c-42ae-bf12-6b1a8756fc7f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.418349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24288baf-025c-42ae-bf12-6b1a8756fc7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:11.425252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-24288baf-025c-42ae-bf12-6b1a8756fc7f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:29:11.426618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 410/828] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:11.432628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293918b-9e30-41e7-87b1-30042eaba52c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.437134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580dc3d-7f05-43bc-82d8-3609adb6be3e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.437417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580dc3d-7f05-43bc-82d8-3609adb6be3e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.437694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580dc3d-7f05-43bc-82d8-3609adb6be3e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.439694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 411/829] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:29:11.444498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15cff-604e-4b00-9706-643b04de990c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.444789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15cff-604e-4b00-9706-643b04de990c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.445071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd15cff-604e-4b00-9706-643b04de990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.445443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293918b-9e30-41e7-87b1-30042eaba52c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.460011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85527fe-9894-4a9b-bafe-3b1a4e6be0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.460725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85527fe-9894-4a9b-bafe-3b1a4e6be0ab admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.461005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85527fe-9894-4a9b-bafe-3b1a4e6be0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.461278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85527fe-9894-4a9b-bafe-3b1a4e6be0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.462044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85527fe-9894-4a9b-bafe-3b1a4e6be0ab admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:11.462352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85527fe-9894-4a9b-bafe-3b1a4e6be0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.463959 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85527fe-9894-4a9b-bafe-3b1a4e6be0ab admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.478786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5bd15cff-604e-4b00-9706-643b04de990c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:11.479993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5bd15cff-604e-4b00-9706-643b04de990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:11.482860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 419/830] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:11.489111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85527fe-9894-4a9b-bafe-3b1a4e6be0ab admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.497614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 412/831] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:11 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:29:11.506594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85527fe-9894-4a9b-bafe-3b1a4e6be0ab admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.511232 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b9c7-1680-43f2-a427-b4ac3bb3e273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.512011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b9c7-1680-43f2-a427-b4ac3bb3e273 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.512293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b9c7-1680-43f2-a427-b4ac3bb3e273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.512599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b9c7-1680-43f2-a427-b4ac3bb3e273 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.530127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0b9c7-1680-43f2-a427-b4ac3bb3e273 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.532237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0b9c7-1680-43f2-a427-b4ac3bb3e273 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.533562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385fd8-27d8-451f-b785-3ad35b3227a2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.533942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385fd8-27d8-451f-b785-3ad35b3227a2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.534307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6385fd8-27d8-451f-b785-3ad35b3227a2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.536410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 413/832] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:29:11.541750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1721a-f6fd-4b28-b2e1-486925a3625d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.542027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1721a-f6fd-4b28-b2e1-486925a3625d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.542300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1721a-f6fd-4b28-b2e1-486925a3625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.555191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b1b0b9c7-1680-43f2-a427-b4ac3bb3e273 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:11.557050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 420/833] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:11.558017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b9c7-1680-43f2-a427-b4ac3bb3e273 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.561961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d9e1721a-f6fd-4b28-b2e1-486925a3625d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:11.562616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d9e1721a-f6fd-4b28-b2e1-486925a3625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:11.571733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 414/834] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:11 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:29:11.572922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1721a-f6fd-4b28-b2e1-486925a3625d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.573527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b9c7-1680-43f2-a427-b4ac3bb3e273 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.584896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8f2c9-d33a-43b7-94c8-85ab19fe168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.586117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8f2c9-d33a-43b7-94c8-85ab19fe168d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.586828 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8f2c9-d33a-43b7-94c8-85ab19fe168d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.589223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1721a-f6fd-4b28-b2e1-486925a3625d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.589741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8f2c9-d33a-43b7-94c8-85ab19fe168d admin admin] PATH_INFO: `/v3/services/network` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.590617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8f2c9-d33a-43b7-94c8-85ab19fe168d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.594409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8f2c9-d33a-43b7-94c8-85ab19fe168d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.600177 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe108b-243d-413f-bf9f-3c1c5b4ac105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.601194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe108b-243d-413f-bf9f-3c1c5b4ac105 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.601476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe108b-243d-413f-bf9f-3c1c5b4ac105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.601775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe108b-243d-413f-bf9f-3c1c5b4ac105 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.602511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe108b-243d-413f-bf9f-3c1c5b4ac105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:11.602814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe108b-243d-413f-bf9f-3c1c5b4ac105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.604435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe108b-243d-413f-bf9f-3c1c5b4ac105 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.615352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-89e8f2c9-d33a-43b7-94c8-85ab19fe168d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 07 02:29:11.616268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 415/835] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:11.617023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 421/836] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/services/network => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:11.617341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe108b-243d-413f-bf9f-3c1c5b4ac105 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.622704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8f2c9-d33a-43b7-94c8-85ab19fe168d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.639090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe108b-243d-413f-bf9f-3c1c5b4ac105 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.642167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8f2c9-d33a-43b7-94c8-85ab19fe168d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.643653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187b218-8ca1-4777-94ee-0e945aa09d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.644489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187b218-8ca1-4777-94ee-0e945aa09d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.644844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187b218-8ca1-4777-94ee-0e945aa09d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.645120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187b218-8ca1-4777-94ee-0e945aa09d5b admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.645872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187b218-8ca1-4777-94ee-0e945aa09d5b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.648118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187b218-8ca1-4777-94ee-0e945aa09d5b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.649128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf7623-38a9-48ec-8fda-2745e82d6561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.650283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf7623-38a9-48ec-8fda-2745e82d6561 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.651110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf7623-38a9-48ec-8fda-2745e82d6561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.651584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf7623-38a9-48ec-8fda-2745e82d6561 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.652793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf7623-38a9-48ec-8fda-2745e82d6561 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:11.653314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf7623-38a9-48ec-8fda-2745e82d6561 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.655072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf7623-38a9-48ec-8fda-2745e82d6561 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.660004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c187b218-8ca1-4777-94ee-0e945aa09d5b admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 07 02:29:11.660657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 422/837] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:11.661581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 416/838] 10.222.0.15 () {56 vars in 1153 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:11.661966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf7623-38a9-48ec-8fda-2745e82d6561 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.667054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187b218-8ca1-4777-94ee-0e945aa09d5b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.678965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187b218-8ca1-4777-94ee-0e945aa09d5b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.679446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf7623-38a9-48ec-8fda-2745e82d6561 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.683835 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cb5d6-ea3e-4297-90d1-734e7b6a9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.684660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cb5d6-ea3e-4297-90d1-734e7b6a9c6f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.684940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cb5d6-ea3e-4297-90d1-734e7b6a9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.685214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cb5d6-ea3e-4297-90d1-734e7b6a9c6f admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.685579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfa5bd-d119-4346-9240-6b80c83a367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.685981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cb5d6-ea3e-4297-90d1-734e7b6a9c6f admin admin] RBAC: Adding query filter params (type=network) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:11.686282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cb5d6-ea3e-4297-90d1-734e7b6a9c6f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.687005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfa5bd-d119-4346-9240-6b80c83a367d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.687474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfa5bd-d119-4346-9240-6b80c83a367d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.687906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cb5d6-ea3e-4297-90d1-734e7b6a9c6f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.688175 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfa5bd-d119-4346-9240-6b80c83a367d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.694081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 417/839] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:11.694853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cb5d6-ea3e-4297-90d1-734e7b6a9c6f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.698509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfa5bd-d119-4346-9240-6b80c83a367d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.701764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfa5bd-d119-4346-9240-6b80c83a367d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.704698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cb5d6-ea3e-4297-90d1-734e7b6a9c6f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.709726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282bd19-dba1-4927-8cfa-37f4d8245a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.710359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282bd19-dba1-4927-8cfa-37f4d8245a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.710633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282bd19-dba1-4927-8cfa-37f4d8245a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.710905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282bd19-dba1-4927-8cfa-37f4d8245a34 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.711603 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282bd19-dba1-4927-8cfa-37f4d8245a34 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:11.711904 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282bd19-dba1-4927-8cfa-37f4d8245a34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.713591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282bd19-dba1-4927-8cfa-37f4d8245a34 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.720893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-13dfa5bd-d119-4346-9240-6b80c83a367d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 02:29:11.722529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 423/841] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:11.722814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 418/841] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:11.727343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282bd19-dba1-4927-8cfa-37f4d8245a34 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.727456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfa5bd-d119-4346-9240-6b80c83a367d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.735848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282bd19-dba1-4927-8cfa-37f4d8245a34 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.739257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfa5bd-d119-4346-9240-6b80c83a367d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.740368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5364b8-3876-42cb-a0c2-8aafa7f9ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.741023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5364b8-3876-42cb-a0c2-8aafa7f9ea65 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.741301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5364b8-3876-42cb-a0c2-8aafa7f9ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.741576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5364b8-3876-42cb-a0c2-8aafa7f9ea65 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.742385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5364b8-3876-42cb-a0c2-8aafa7f9ea65 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:11.742689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5364b8-3876-42cb-a0c2-8aafa7f9ea65 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.744482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5364b8-3876-42cb-a0c2-8aafa7f9ea65 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.745846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb49b3-180d-4f3f-be15-6460488aae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.747033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb49b3-180d-4f3f-be15-6460488aae1d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.747767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb49b3-180d-4f3f-be15-6460488aae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.748254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb49b3-180d-4f3f-be15-6460488aae1d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.749227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb49b3-180d-4f3f-be15-6460488aae1d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.750998 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb49b3-180d-4f3f-be15-6460488aae1d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.752432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 419/842] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:11.753498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5364b8-3876-42cb-a0c2-8aafa7f9ea65 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.777958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5364b8-3876-42cb-a0c2-8aafa7f9ea65 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.784371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b92943-2238-4f89-b4ff-ca7f3f74b088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.785564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b92943-2238-4f89-b4ff-ca7f3f74b088 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.786081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b92943-2238-4f89-b4ff-ca7f3f74b088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.786605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b92943-2238-4f89-b4ff-ca7f3f74b088 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.796209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 424/843] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Feb 7 02:29:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:11.797558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b92943-2238-4f89-b4ff-ca7f3f74b088 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:11.798130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b92943-2238-4f89-b4ff-ca7f3f74b088 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.800662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b92943-2238-4f89-b4ff-ca7f3f74b088 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.828554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 420/844] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:11.831029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb49b3-180d-4f3f-be15-6460488aae1d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.853776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb49b3-180d-4f3f-be15-6460488aae1d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.858834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f67b7-a563-4509-9f98-9f2b2979bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.859762 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f67b7-a563-4509-9f98-9f2b2979bc08 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.860243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f67b7-a563-4509-9f98-9f2b2979bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.860777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f67b7-a563-4509-9f98-9f2b2979bc08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.870357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f67b7-a563-4509-9f98-9f2b2979bc08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.872643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f67b7-a563-4509-9f98-9f2b2979bc08 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.884204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 425/845] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:11.890300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b92943-2238-4f89-b4ff-ca7f3f74b088 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.902095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b92943-2238-4f89-b4ff-ca7f3f74b088 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.907217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e5fbd-2061-4497-89e6-e938ff929cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.908280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5fbd-2061-4497-89e6-e938ff929cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.908807 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5fbd-2061-4497-89e6-e938ff929cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.909307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e5fbd-2061-4497-89e6-e938ff929cc4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.921758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e5fbd-2061-4497-89e6-e938ff929cc4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.923932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e5fbd-2061-4497-89e6-e938ff929cc4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.942738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-be1e5fbd-2061-4497-89e6-e938ff929cc4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:11.945230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 421/846] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:11.951348 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f67b7-a563-4509-9f98-9f2b2979bc08 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:11.961252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f67b7-a563-4509-9f98-9f2b2979bc08 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:11.968599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32a03-b078-4d59-85b7-5247defc9d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:11.969577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32a03-b078-4d59-85b7-5247defc9d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:11.970056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32a03-b078-4d59-85b7-5247defc9d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:11.970504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32a03-b078-4d59-85b7-5247defc9d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:11.971441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32a03-b078-4d59-85b7-5247defc9d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:11.971923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32a03-b078-4d59-85b7-5247defc9d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:11.973742 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32a03-b078-4d59-85b7-5247defc9d4a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:11.987090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 426/847] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:11.993419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e5fbd-2061-4497-89e6-e938ff929cc4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.004244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e5fbd-2061-4497-89e6-e938ff929cc4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.009918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbffed-3d7d-47ca-9c0b-6b069066a576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.010976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbffed-3d7d-47ca-9c0b-6b069066a576 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.011445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbffed-3d7d-47ca-9c0b-6b069066a576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.011932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbffed-3d7d-47ca-9c0b-6b069066a576 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.020113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbffed-3d7d-47ca-9c0b-6b069066a576 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.022432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbffed-3d7d-47ca-9c0b-6b069066a576 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.037079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a8dbffed-3d7d-47ca-9c0b-6b069066a576 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:12.038929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 422/848] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:12.044790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32a03-b078-4d59-85b7-5247defc9d4a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.055585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32a03-b078-4d59-85b7-5247defc9d4a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.060567 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7b1f6-2fc0-4490-bee9-c6bd44614d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.061431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b1f6-2fc0-4490-bee9-c6bd44614d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.061940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b1f6-2fc0-4490-bee9-c6bd44614d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.062387 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7b1f6-2fc0-4490-bee9-c6bd44614d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.063426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7b1f6-2fc0-4490-bee9-c6bd44614d90 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:12.063908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7b1f6-2fc0-4490-bee9-c6bd44614d90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.065958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7b1f6-2fc0-4490-bee9-c6bd44614d90 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.080244 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 427/849] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:12.086367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbffed-3d7d-47ca-9c0b-6b069066a576 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.097296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbffed-3d7d-47ca-9c0b-6b069066a576 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.102151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d7203-ecc5-4cbf-a7cc-e54b87485a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.102999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d7203-ecc5-4cbf-a7cc-e54b87485a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.103456 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d7203-ecc5-4cbf-a7cc-e54b87485a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.103905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d7203-ecc5-4cbf-a7cc-e54b87485a21 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.104963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d7203-ecc5-4cbf-a7cc-e54b87485a21 admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=042a422ead5c48f1a428028abe9e419b) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:12.105452 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d7203-ecc5-4cbf-a7cc-e54b87485a21 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.107458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d7203-ecc5-4cbf-a7cc-e54b87485a21 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.114404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 423/850] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/role_assignments?user.id=042a422ead5c48f1a428028abe9e419b&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:12.475069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5c9d3-461e-410f-9b21-962ec93bb0f6 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.475602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5c9d3-461e-410f-9b21-962ec93bb0f6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.475602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5c9d3-461e-410f-9b21-962ec93bb0f6 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.477540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 428/851] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:12.482860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21557-0b53-40e2-a57b-86a3208919cf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.483253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21557-0b53-40e2-a57b-86a3208919cf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.483434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba21557-0b53-40e2-a57b-86a3208919cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.501156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2ba21557-0b53-40e2-a57b-86a3208919cf None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:12.502370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2ba21557-0b53-40e2-a57b-86a3208919cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:12.516546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 424/852] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:12 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:12.535552 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5c9d3-461e-410f-9b21-962ec93bb0f6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.548118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5c9d3-461e-410f-9b21-962ec93bb0f6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.552600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85f692-3b66-47d0-bd12-d4c3c532b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.553455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85f692-3b66-47d0-bd12-d4c3c532b1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.553764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85f692-3b66-47d0-bd12-d4c3c532b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.554044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85f692-3b66-47d0-bd12-d4c3c532b1e5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.564821 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85f692-3b66-47d0-bd12-d4c3c532b1e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:12.572120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-bf85f692-3b66-47d0-bd12-d4c3c532b1e5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:12.578408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 429/853] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:12.579839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21557-0b53-40e2-a57b-86a3208919cf None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.589367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba21557-0b53-40e2-a57b-86a3208919cf None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.593941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1039dbf-016d-4386-bfcf-5b505ef798f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.594590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1039dbf-016d-4386-bfcf-5b505ef798f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.594866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1039dbf-016d-4386-bfcf-5b505ef798f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.595135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1039dbf-016d-4386-bfcf-5b505ef798f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.595892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1039dbf-016d-4386-bfcf-5b505ef798f5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:12.596189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1039dbf-016d-4386-bfcf-5b505ef798f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.597812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1039dbf-016d-4386-bfcf-5b505ef798f5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.610249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 425/854] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:12.612289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85f692-3b66-47d0-bd12-d4c3c532b1e5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.622499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85f692-3b66-47d0-bd12-d4c3c532b1e5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.628595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58289857-e6fd-4644-8bd9-8bed85ebcdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.632364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58289857-e6fd-4644-8bd9-8bed85ebcdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.632364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58289857-e6fd-4644-8bd9-8bed85ebcdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.632364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58289857-e6fd-4644-8bd9-8bed85ebcdc2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.642155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58289857-e6fd-4644-8bd9-8bed85ebcdc2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.644009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58289857-e6fd-4644-8bd9-8bed85ebcdc2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.661015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-58289857-e6fd-4644-8bd9-8bed85ebcdc2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:12.666798 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 430/855] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:12.668227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1039dbf-016d-4386-bfcf-5b505ef798f5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.682901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1039dbf-016d-4386-bfcf-5b505ef798f5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.687886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dc6a1-50a8-4826-9ae3-354f268ea92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.688838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dc6a1-50a8-4826-9ae3-354f268ea92f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.689374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dc6a1-50a8-4826-9ae3-354f268ea92f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.689862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8dc6a1-50a8-4826-9ae3-354f268ea92f admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.690841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dc6a1-50a8-4826-9ae3-354f268ea92f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:12.691359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dc6a1-50a8-4826-9ae3-354f268ea92f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.693813 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8dc6a1-50a8-4826-9ae3-354f268ea92f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.706806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 426/856] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:12.717378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58289857-e6fd-4644-8bd9-8bed85ebcdc2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.727364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58289857-e6fd-4644-8bd9-8bed85ebcdc2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.732022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf16a74-4954-4b6c-824e-b546f9e2e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.732875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf16a74-4954-4b6c-824e-b546f9e2e106 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.733149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf16a74-4954-4b6c-824e-b546f9e2e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.733463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf16a74-4954-4b6c-824e-b546f9e2e106 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.742092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf16a74-4954-4b6c-824e-b546f9e2e106 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.744189 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf16a74-4954-4b6c-824e-b546f9e2e106 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.757822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-dbf16a74-4954-4b6c-824e-b546f9e2e106 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 07 02:29:12.763549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 431/857] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:12.764910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dc6a1-50a8-4826-9ae3-354f268ea92f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.775013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8dc6a1-50a8-4826-9ae3-354f268ea92f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.779800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5762d2-46c6-40c7-80e2-99bdb41d0eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.780740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5762d2-46c6-40c7-80e2-99bdb41d0eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.781253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5762d2-46c6-40c7-80e2-99bdb41d0eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.781735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5762d2-46c6-40c7-80e2-99bdb41d0eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.782823 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5762d2-46c6-40c7-80e2-99bdb41d0eb2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:12.783326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5762d2-46c6-40c7-80e2-99bdb41d0eb2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.785388 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5762d2-46c6-40c7-80e2-99bdb41d0eb2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.803527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 427/858] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:12.808734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf16a74-4954-4b6c-824e-b546f9e2e106 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.822314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf16a74-4954-4b6c-824e-b546f9e2e106 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.827119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c9130-6808-4028-9618-6cdeb479487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.827795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c9130-6808-4028-9618-6cdeb479487d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.828126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c9130-6808-4028-9618-6cdeb479487d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.828435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c9130-6808-4028-9618-6cdeb479487d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.836568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c9130-6808-4028-9618-6cdeb479487d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.838365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c9130-6808-4028-9618-6cdeb479487d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.851811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 432/859] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:12.853167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5762d2-46c6-40c7-80e2-99bdb41d0eb2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.862940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5762d2-46c6-40c7-80e2-99bdb41d0eb2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.868231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935106dc-50cb-48fa-bd52-57dfde3d139a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.869044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935106dc-50cb-48fa-bd52-57dfde3d139a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.869373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935106dc-50cb-48fa-bd52-57dfde3d139a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.869641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935106dc-50cb-48fa-bd52-57dfde3d139a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.880159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935106dc-50cb-48fa-bd52-57dfde3d139a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.882616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935106dc-50cb-48fa-bd52-57dfde3d139a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.899065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-935106dc-50cb-48fa-bd52-57dfde3d139a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:12.904479 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 428/860] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:12.906147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c9130-6808-4028-9618-6cdeb479487d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.915088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c9130-6808-4028-9618-6cdeb479487d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.919840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05e9db-694b-4e86-bf22-9f59eaf52427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.920514 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05e9db-694b-4e86-bf22-9f59eaf52427 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.920791 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05e9db-694b-4e86-bf22-9f59eaf52427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.921061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05e9db-694b-4e86-bf22-9f59eaf52427 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.921780 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05e9db-694b-4e86-bf22-9f59eaf52427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:12.922076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05e9db-694b-4e86-bf22-9f59eaf52427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.923717 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05e9db-694b-4e86-bf22-9f59eaf52427 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.940470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 433/861] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:12.942238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935106dc-50cb-48fa-bd52-57dfde3d139a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:12.953147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935106dc-50cb-48fa-bd52-57dfde3d139a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:12.957864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d96d7f-21e9-4407-8d29-eb6d311f0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:12.958694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d96d7f-21e9-4407-8d29-eb6d311f0a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:12.959052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d96d7f-21e9-4407-8d29-eb6d311f0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:12.959322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d96d7f-21e9-4407-8d29-eb6d311f0a53 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:12.966595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d96d7f-21e9-4407-8d29-eb6d311f0a53 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:12.968693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d96d7f-21e9-4407-8d29-eb6d311f0a53 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:12.982042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-11d96d7f-21e9-4407-8d29-eb6d311f0a53 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:12.988126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 429/862] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:12.989644 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05e9db-694b-4e86-bf22-9f59eaf52427 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:13.000867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05e9db-694b-4e86-bf22-9f59eaf52427 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:13.006471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066a7fb-6e1d-4b85-b53a-688efce0c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:13.007126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066a7fb-6e1d-4b85-b53a-688efce0c67d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:13.007452 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066a7fb-6e1d-4b85-b53a-688efce0c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:13.007729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066a7fb-6e1d-4b85-b53a-688efce0c67d admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:13.008607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066a7fb-6e1d-4b85-b53a-688efce0c67d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:13.008919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066a7fb-6e1d-4b85-b53a-688efce0c67d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:13.010826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066a7fb-6e1d-4b85-b53a-688efce0c67d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:13.028065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 434/863] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:13.029541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d96d7f-21e9-4407-8d29-eb6d311f0a53 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:13.040733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d96d7f-21e9-4407-8d29-eb6d311f0a53 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:13.045801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780799b-789b-4488-a0ed-fcde3edfe991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:13.046491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780799b-789b-4488-a0ed-fcde3edfe991 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:13.046810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780799b-789b-4488-a0ed-fcde3edfe991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:13.047131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780799b-789b-4488-a0ed-fcde3edfe991 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:13.048016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780799b-789b-4488-a0ed-fcde3edfe991 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=2074fd021729416ea1c9b596d0bb892b) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:13.048396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780799b-789b-4488-a0ed-fcde3edfe991 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:13.050333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780799b-789b-4488-a0ed-fcde3edfe991 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:13.060447 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 430/864] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:13 2022] GET /identity/v3/role_assignments?user.id=2074fd021729416ea1c9b596d0bb892b&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:13.650884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebad6-3fcc-40e5-9d9d-47dd9a8e2e5f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:13.651429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebad6-3fcc-40e5-9d9d-47dd9a8e2e5f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:13.651429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ebad6-3fcc-40e5-9d9d-47dd9a8e2e5f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:13.653486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 435/865] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:13.658665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b03c6-4ef2-4b50-a040-0de7f9a01921 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:13.659079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b03c6-4ef2-4b50-a040-0de7f9a01921 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:13.659271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b03c6-4ef2-4b50-a040-0de7f9a01921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:13.681575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9e6b03c6-4ef2-4b50-a040-0de7f9a01921 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:13.682817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9e6b03c6-4ef2-4b50-a040-0de7f9a01921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:13.690862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 431/866] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:13 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:13.714126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebad6-3fcc-40e5-9d9d-47dd9a8e2e5f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:13.726678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ebad6-3fcc-40e5-9d9d-47dd9a8e2e5f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:13.731097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f50a6-4846-45ad-87d2-0e79120b8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:13.731886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f50a6-4846-45ad-87d2-0e79120b8a63 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:13.732160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f50a6-4846-45ad-87d2-0e79120b8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:13.732463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f50a6-4846-45ad-87d2-0e79120b8a63 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:13.733121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f50a6-4846-45ad-87d2-0e79120b8a63 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:13.734705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f50a6-4846-45ad-87d2-0e79120b8a63 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:13.746209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-c11f50a6-4846-45ad-87d2-0e79120b8a63 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 07 02:29:13.747664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 436/867] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:29:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:13.753512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b03c6-4ef2-4b50-a040-0de7f9a01921 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:13.763142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b03c6-4ef2-4b50-a040-0de7f9a01921 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:13.767843 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5476be-2930-4560-8ad9-52337e171f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:13.768530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5476be-2930-4560-8ad9-52337e171f57 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:13.768812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5476be-2930-4560-8ad9-52337e171f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:13.769083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5476be-2930-4560-8ad9-52337e171f57 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:13.769792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5476be-2930-4560-8ad9-52337e171f57 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:13.770096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5476be-2930-4560-8ad9-52337e171f57 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:13.771776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5476be-2930-4560-8ad9-52337e171f57 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:13.776740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 432/868] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:29:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:13.782112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f50a6-4846-45ad-87d2-0e79120b8a63 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:13.791792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f50a6-4846-45ad-87d2-0e79120b8a63 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:13.796243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58a881-b2c7-428f-a056-51938f849246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:13.796926 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a881-b2c7-428f-a056-51938f849246 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:13.797203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a881-b2c7-428f-a056-51938f849246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:13.797473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a881-b2c7-428f-a056-51938f849246 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:13.798174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58a881-b2c7-428f-a056-51938f849246 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:13.798473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58a881-b2c7-428f-a056-51938f849246 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:13.800047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58a881-b2c7-428f-a056-51938f849246 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:13.805560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 437/869] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:29:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:14.104891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b65aa-01cc-428c-9f72-298020cf0e22 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.105247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b65aa-01cc-428c-9f72-298020cf0e22 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.105348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b65aa-01cc-428c-9f72-298020cf0e22 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.107235 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 433/870] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:14.112641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6fb71-53b6-4e38-81e1-29ebc6c71181 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.113165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6fb71-53b6-4e38-81e1-29ebc6c71181 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.113637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6fb71-53b6-4e38-81e1-29ebc6c71181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.133148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-22a6fb71-53b6-4e38-81e1-29ebc6c71181 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:14.134680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-22a6fb71-53b6-4e38-81e1-29ebc6c71181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:14.143160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 438/871] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:14 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:14.166646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b65aa-01cc-428c-9f72-298020cf0e22 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:14.180002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b65aa-01cc-428c-9f72-298020cf0e22 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:14.184762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcce479-69d7-400f-b916-8c9774db9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:14.185639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcce479-69d7-400f-b916-8c9774db9887 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.186117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcce479-69d7-400f-b916-8c9774db9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.186604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcce479-69d7-400f-b916-8c9774db9887 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.187536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcce479-69d7-400f-b916-8c9774db9887 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:14.189346 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcce479-69d7-400f-b916-8c9774db9887 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:14.207307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 434/872] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:29:14 2022] POST /identity/v3/services => generated 269 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:14.606694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d64111-3716-4f6d-b3cb-dbe1d65b5a24 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.607108 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d64111-3716-4f6d-b3cb-dbe1d65b5a24 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.607284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d64111-3716-4f6d-b3cb-dbe1d65b5a24 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.609283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 439/873] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:14.614731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26787-8e5b-48b2-8592-91f6b7a64106 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.615060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26787-8e5b-48b2-8592-91f6b7a64106 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.615338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f26787-8e5b-48b2-8592-91f6b7a64106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.639408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-12f26787-8e5b-48b2-8592-91f6b7a64106 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:14.640629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-12f26787-8e5b-48b2-8592-91f6b7a64106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:14.657509 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 435/874] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:14 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:14.684038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d64111-3716-4f6d-b3cb-dbe1d65b5a24 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:14.697110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d64111-3716-4f6d-b3cb-dbe1d65b5a24 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:14.701724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8133-732c-4c3c-9a13-356c4ddb05fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:14.702514 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8133-732c-4c3c-9a13-356c4ddb05fb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.702791 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8133-732c-4c3c-9a13-356c4ddb05fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.703065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f8133-732c-4c3c-9a13-356c4ddb05fb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.714158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f8133-732c-4c3c-9a13-356c4ddb05fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:14.721442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-bb9f8133-732c-4c3c-9a13-356c4ddb05fb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 02:29:14.722908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 440/875] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Feb 7 02:29:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:14.728691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f26787-8e5b-48b2-8592-91f6b7a64106 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:14.737793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f26787-8e5b-48b2-8592-91f6b7a64106 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:14.742369 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326dea-661d-460d-98dd-e67281241b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:14.743028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326dea-661d-460d-98dd-e67281241b6b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.743306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326dea-661d-460d-98dd-e67281241b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.743583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326dea-661d-460d-98dd-e67281241b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.744363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326dea-661d-460d-98dd-e67281241b6b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:14.744672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326dea-661d-460d-98dd-e67281241b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:14.746252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326dea-661d-460d-98dd-e67281241b6b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:14.754551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 436/876] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Feb 7 02:29:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:14.760362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8133-732c-4c3c-9a13-356c4ddb05fb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:14.770133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f8133-732c-4c3c-9a13-356c4ddb05fb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:14.775242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14129f-0d53-4349-b940-ba3d949a5324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:14.776021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14129f-0d53-4349-b940-ba3d949a5324 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.776300 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14129f-0d53-4349-b940-ba3d949a5324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.776604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14129f-0d53-4349-b940-ba3d949a5324 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.787687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14129f-0d53-4349-b940-ba3d949a5324 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:14.789582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14129f-0d53-4349-b940-ba3d949a5324 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:14.806081 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-fa14129f-0d53-4349-b940-ba3d949a5324 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:14.807566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 441/877] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:14.813054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326dea-661d-460d-98dd-e67281241b6b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:14.824019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326dea-661d-460d-98dd-e67281241b6b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:14.829301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992abe0d-fd9a-4f35-9e33-163c025c5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:14.830226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992abe0d-fd9a-4f35-9e33-163c025c5d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.830752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992abe0d-fd9a-4f35-9e33-163c025c5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.831257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992abe0d-fd9a-4f35-9e33-163c025c5d94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.832214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992abe0d-fd9a-4f35-9e33-163c025c5d94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:14.832779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992abe0d-fd9a-4f35-9e33-163c025c5d94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:14.835133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992abe0d-fd9a-4f35-9e33-163c025c5d94 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:14.848641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 437/878] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:14.857789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14129f-0d53-4349-b940-ba3d949a5324 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:14.868133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14129f-0d53-4349-b940-ba3d949a5324 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:14.872824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c25a20-bd9f-4ec4-b24c-303699582457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:14.873619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c25a20-bd9f-4ec4-b24c-303699582457 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.873947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c25a20-bd9f-4ec4-b24c-303699582457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.874267 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c25a20-bd9f-4ec4-b24c-303699582457 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.883322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c25a20-bd9f-4ec4-b24c-303699582457 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:14.885454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c25a20-bd9f-4ec4-b24c-303699582457 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:14.899788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-27c25a20-bd9f-4ec4-b24c-303699582457 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 02:29:14.901320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 442/879] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:29:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:14.906898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992abe0d-fd9a-4f35-9e33-163c025c5d94 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:14.917648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992abe0d-fd9a-4f35-9e33-163c025c5d94 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:14.922281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49dd9-54ef-4b16-b536-e673b53c77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:14.922999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49dd9-54ef-4b16-b536-e673b53c77d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.923329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49dd9-54ef-4b16-b536-e673b53c77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.923608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49dd9-54ef-4b16-b536-e673b53c77d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.924527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49dd9-54ef-4b16-b536-e673b53c77d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:14.924837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49dd9-54ef-4b16-b536-e673b53c77d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:14.926867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49dd9-54ef-4b16-b536-e673b53c77d6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:14.947471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 438/880] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Feb 7 02:29:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:14.953394 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c25a20-bd9f-4ec4-b24c-303699582457 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:14.964374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c25a20-bd9f-4ec4-b24c-303699582457 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:14.969125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d78b-5fe5-4f23-bba0-200eba0a2027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:14.969885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d78b-5fe5-4f23-bba0-200eba0a2027 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:14.970164 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d78b-5fe5-4f23-bba0-200eba0a2027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:14.970438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636d78b-5fe5-4f23-bba0-200eba0a2027 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:14.979954 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636d78b-5fe5-4f23-bba0-200eba0a2027 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:14.981788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636d78b-5fe5-4f23-bba0-200eba0a2027 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:14.991493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 443/881] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:14 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:14.997147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49dd9-54ef-4b16-b536-e673b53c77d6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:15.007251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49dd9-54ef-4b16-b536-e673b53c77d6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:15.011986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0063f-f0af-458d-b000-ed36aa842065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:15.012918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0063f-f0af-458d-b000-ed36aa842065 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.013202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0063f-f0af-458d-b000-ed36aa842065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.013476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0063f-f0af-458d-b000-ed36aa842065 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.024672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0063f-f0af-458d-b000-ed36aa842065 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:15.026555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0063f-f0af-458d-b000-ed36aa842065 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:15.044482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a0a0063f-f0af-458d-b000-ed36aa842065 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:15.046046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 439/882] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:15.051618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d78b-5fe5-4f23-bba0-200eba0a2027 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:15.061118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636d78b-5fe5-4f23-bba0-200eba0a2027 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:15.066065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b37cf-8b32-4c1d-8573-53706ae8547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:15.066751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b37cf-8b32-4c1d-8573-53706ae8547a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.067029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b37cf-8b32-4c1d-8573-53706ae8547a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.067304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b37cf-8b32-4c1d-8573-53706ae8547a admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.068088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b37cf-8b32-4c1d-8573-53706ae8547a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:15.068436 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b37cf-8b32-4c1d-8573-53706ae8547a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:15.070235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b37cf-8b32-4c1d-8573-53706ae8547a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:15.085700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 444/883] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:15.091270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0063f-f0af-458d-b000-ed36aa842065 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:15.102172 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0063f-f0af-458d-b000-ed36aa842065 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:15.106889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec8b5-8146-4836-a5d2-4f906f8a1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:15.107723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec8b5-8146-4836-a5d2-4f906f8a1450 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.108108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec8b5-8146-4836-a5d2-4f906f8a1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.108328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec8b5-8146-4836-a5d2-4f906f8a1450 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.115643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ec8b5-8146-4836-a5d2-4f906f8a1450 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:15.117664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ec8b5-8146-4836-a5d2-4f906f8a1450 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:15.130858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-690ec8b5-8146-4836-a5d2-4f906f8a1450 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:15.132326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 440/884] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:15.137990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b37cf-8b32-4c1d-8573-53706ae8547a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:15.148643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b37cf-8b32-4c1d-8573-53706ae8547a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:15.153374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649ed95-3984-42c6-b87e-971741418dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:15.154076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649ed95-3984-42c6-b87e-971741418dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.154355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649ed95-3984-42c6-b87e-971741418dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.154686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649ed95-3984-42c6-b87e-971741418dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.155477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649ed95-3984-42c6-b87e-971741418dd6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:15.155835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649ed95-3984-42c6-b87e-971741418dd6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:15.157728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649ed95-3984-42c6-b87e-971741418dd6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:15.169836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 445/885] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:15.175616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec8b5-8146-4836-a5d2-4f906f8a1450 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:15.186573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec8b5-8146-4836-a5d2-4f906f8a1450 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:15.191081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc43023-badb-42e8-9550-42bb4fc6d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:15.191726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc43023-badb-42e8-9550-42bb4fc6d8fd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.192002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc43023-badb-42e8-9550-42bb4fc6d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.192276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc43023-badb-42e8-9550-42bb4fc6d8fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.193726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc43023-badb-42e8-9550-42bb4fc6d8fd admin admin] RBAC: Adding query filter params (role.id=1f9e05b1bffc4dc291c6b46b5a84cc3c, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=042a422ead5c48f1a428028abe9e419b) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:15.194037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc43023-badb-42e8-9550-42bb4fc6d8fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:15.195867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc43023-badb-42e8-9550-42bb4fc6d8fd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:15.202205 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 441/886] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:15 2022] GET /identity/v3/role_assignments?user.id=042a422ead5c48f1a428028abe9e419b&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=1f9e05b1bffc4dc291c6b46b5a84cc3c => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:15.350166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d93a5-7fbf-4d81-9d2c-a87103f4ed38 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.350450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d93a5-7fbf-4d81-9d2c-a87103f4ed38 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.350726 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d93a5-7fbf-4d81-9d2c-a87103f4ed38 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.352835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 446/887] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:15.358684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de081-b751-49e2-b262-b2775d6303e1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.359145 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de081-b751-49e2-b262-b2775d6303e1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.359572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de081-b751-49e2-b262-b2775d6303e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.379894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f59de081-b751-49e2-b262-b2775d6303e1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:15.381153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f59de081-b751-49e2-b262-b2775d6303e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:15.390498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 442/888] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:15 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:15.413282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d93a5-7fbf-4d81-9d2c-a87103f4ed38 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:15.426528 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d93a5-7fbf-4d81-9d2c-a87103f4ed38 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:15.432454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15c113-7c62-4c4c-9a92-4ac7b7c47d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:15.433634 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c113-7c62-4c4c-9a92-4ac7b7c47d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.434151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c113-7c62-4c4c-9a92-4ac7b7c47d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.434669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15c113-7c62-4c4c-9a92-4ac7b7c47d34 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.435598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15c113-7c62-4c4c-9a92-4ac7b7c47d34 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:15.437469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15c113-7c62-4c4c-9a92-4ac7b7c47d34 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:15.449646 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-4d15c113-7c62-4c4c-9a92-4ac7b7c47d34 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 02:29:15.456385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 447/889] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:15.457957 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de081-b751-49e2-b262-b2775d6303e1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:15.466985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de081-b751-49e2-b262-b2775d6303e1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:15.471660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7ce37-ef2f-4bdd-b239-ac1212d7e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:15.472306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7ce37-ef2f-4bdd-b239-ac1212d7e1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.472617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7ce37-ef2f-4bdd-b239-ac1212d7e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.472885 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7ce37-ef2f-4bdd-b239-ac1212d7e1fd admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.473614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7ce37-ef2f-4bdd-b239-ac1212d7e1fd admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:15.473898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7ce37-ef2f-4bdd-b239-ac1212d7e1fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:15.476041 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7ce37-ef2f-4bdd-b239-ac1212d7e1fd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:15.480969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 443/890] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:15.486593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15c113-7c62-4c4c-9a92-4ac7b7c47d34 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:15.497217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15c113-7c62-4c4c-9a92-4ac7b7c47d34 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:15.502106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8724751-9ec9-4484-83b6-231cc166adca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:15.503026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8724751-9ec9-4484-83b6-231cc166adca admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:15.503515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8724751-9ec9-4484-83b6-231cc166adca admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:15.504027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8724751-9ec9-4484-83b6-231cc166adca admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:15.504978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8724751-9ec9-4484-83b6-231cc166adca admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:15.505538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8724751-9ec9-4484-83b6-231cc166adca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:15.508197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8724751-9ec9-4484-83b6-231cc166adca admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:15.519711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 448/891] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:16.077309 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0b3b-3e95-4f97-aaae-bae5eee20f5a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.077804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0b3b-3e95-4f97-aaae-bae5eee20f5a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.077804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c0b3b-3e95-4f97-aaae-bae5eee20f5a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.079855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 444/892] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:16.085883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0a53b-46b7-4f30-b8b1-d435161ff5a4 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.086271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0a53b-46b7-4f30-b8b1-d435161ff5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.086451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0a53b-46b7-4f30-b8b1-d435161ff5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.104198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-33f0a53b-46b7-4f30-b8b1-d435161ff5a4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:16.105412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-33f0a53b-46b7-4f30-b8b1-d435161ff5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:16.113262 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 449/893] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:16 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:16.136433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0b3b-3e95-4f97-aaae-bae5eee20f5a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:16.149084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c0b3b-3e95-4f97-aaae-bae5eee20f5a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:16.153441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfe6a9-3aed-4876-af52-d91c3797d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:16.154078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfe6a9-3aed-4876-af52-d91c3797d7df admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.154350 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfe6a9-3aed-4876-af52-d91c3797d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.154618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfe6a9-3aed-4876-af52-d91c3797d7df admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.155352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfe6a9-3aed-4876-af52-d91c3797d7df admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:16.156950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfe6a9-3aed-4876-af52-d91c3797d7df admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:16.174576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 445/894] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:29:16 2022] POST /identity/v3/services => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:16.536925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642306-454d-45c8-8a0f-ad8dfec56166 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.537295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642306-454d-45c8-8a0f-ad8dfec56166 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.537495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642306-454d-45c8-8a0f-ad8dfec56166 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.539404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 450/895] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:16.546664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4671bcc-90e7-45ed-9ba2-83234a4e00e1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.546664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4671bcc-90e7-45ed-9ba2-83234a4e00e1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.546664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4671bcc-90e7-45ed-9ba2-83234a4e00e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.564038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f4671bcc-90e7-45ed-9ba2-83234a4e00e1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:16.565579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f4671bcc-90e7-45ed-9ba2-83234a4e00e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:16.589804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 446/896] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:16 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:16.612827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642306-454d-45c8-8a0f-ad8dfec56166 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:16.626020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642306-454d-45c8-8a0f-ad8dfec56166 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:16.631368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55f6d2-7873-4aaa-882f-320010a1fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:16.632424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55f6d2-7873-4aaa-882f-320010a1fe13 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.632905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55f6d2-7873-4aaa-882f-320010a1fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.633367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55f6d2-7873-4aaa-882f-320010a1fe13 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.634236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55f6d2-7873-4aaa-882f-320010a1fe13 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:16.636021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55f6d2-7873-4aaa-882f-320010a1fe13 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:16.648000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-3a55f6d2-7873-4aaa-882f-320010a1fe13 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 07 02:29:16.649847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 451/897] 10.222.0.15 () {56 vars in 1153 bytes} [Mon Feb 7 02:29:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:16.656418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4671bcc-90e7-45ed-9ba2-83234a4e00e1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:16.666364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4671bcc-90e7-45ed-9ba2-83234a4e00e1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:16.671448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b5d69-9f92-43d1-98c6-6553b1a07dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:16.672381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b5d69-9f92-43d1-98c6-6553b1a07dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.672869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b5d69-9f92-43d1-98c6-6553b1a07dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.673341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b5d69-9f92-43d1-98c6-6553b1a07dd8 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.674267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b5d69-9f92-43d1-98c6-6553b1a07dd8 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:16.674808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b5d69-9f92-43d1-98c6-6553b1a07dd8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:16.676669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b5d69-9f92-43d1-98c6-6553b1a07dd8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:16.682521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 447/898] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:16.688132 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55f6d2-7873-4aaa-882f-320010a1fe13 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:16.698510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55f6d2-7873-4aaa-882f-320010a1fe13 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:16.703358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156792da-c6a2-4063-93a5-ea253646f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:16.704073 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156792da-c6a2-4063-93a5-ea253646f395 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.704377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156792da-c6a2-4063-93a5-ea253646f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.704707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156792da-c6a2-4063-93a5-ea253646f395 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.705517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156792da-c6a2-4063-93a5-ea253646f395 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:16.705823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156792da-c6a2-4063-93a5-ea253646f395 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:16.707469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156792da-c6a2-4063-93a5-ea253646f395 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:16.712673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 452/899] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:16.718232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b5d69-9f92-43d1-98c6-6553b1a07dd8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:16.728193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b5d69-9f92-43d1-98c6-6553b1a07dd8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:16.732981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880f7e3-c2be-4e69-ba02-52c24fb75ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:16.733672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880f7e3-c2be-4e69-ba02-52c24fb75ced admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.733955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880f7e3-c2be-4e69-ba02-52c24fb75ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.734271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880f7e3-c2be-4e69-ba02-52c24fb75ced admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.735103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880f7e3-c2be-4e69-ba02-52c24fb75ced admin admin] RBAC: Adding query filter params (interface=public, service_id=18e8f5ed214542c2b91e4cb783d1f051, region_id=RegionOne) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:16.735418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880f7e3-c2be-4e69-ba02-52c24fb75ced admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:16.737081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880f7e3-c2be-4e69-ba02-52c24fb75ced admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:16.743329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 448/900] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Feb 7 02:29:16 2022] GET /identity/v3/endpoints?service_id=18e8f5ed214542c2b91e4cb783d1f051&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:16.748589 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156792da-c6a2-4063-93a5-ea253646f395 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:16.759148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156792da-c6a2-4063-93a5-ea253646f395 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:16.763825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf92c5d-7409-4045-ade3-22a8b14ccdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:16.764531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92c5d-7409-4045-ade3-22a8b14ccdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:16.764811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92c5d-7409-4045-ade3-22a8b14ccdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:16.765083 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92c5d-7409-4045-ade3-22a8b14ccdc1 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:16.765770 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf92c5d-7409-4045-ade3-22a8b14ccdc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:16.767344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf92c5d-7409-4045-ade3-22a8b14ccdc1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:16.773400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 453/901] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:29:16 2022] GET /identity/v3/services => generated 1268 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:29:17.469195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0e078-8fe4-4c8e-a1d3-58f56b68c8f2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.469704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0e078-8fe4-4c8e-a1d3-58f56b68c8f2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.469704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0e078-8fe4-4c8e-a1d3-58f56b68c8f2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.471877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 449/902] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:17.477555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7a98f-4a8d-4593-88b9-61c7e49e7781 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.478003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7a98f-4a8d-4593-88b9-61c7e49e7781 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.478141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7a98f-4a8d-4593-88b9-61c7e49e7781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.496324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bdd7a98f-4a8d-4593-88b9-61c7e49e7781 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:17.497562 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bdd7a98f-4a8d-4593-88b9-61c7e49e7781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:17.506025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 454/903] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:17 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:29:17.530239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0e078-8fe4-4c8e-a1d3-58f56b68c8f2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.543189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0e078-8fe4-4c8e-a1d3-58f56b68c8f2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.547680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477af31-5abf-4499-a7ea-ad869f7455c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.548506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477af31-5abf-4499-a7ea-ad869f7455c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.548790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477af31-5abf-4499-a7ea-ad869f7455c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.549066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477af31-5abf-4499-a7ea-ad869f7455c7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.559473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477af31-5abf-4499-a7ea-ad869f7455c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:17.566765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0477af31-5abf-4499-a7ea-ad869f7455c7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 02:29:17.568829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 450/904] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:17.574587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7a98f-4a8d-4593-88b9-61c7e49e7781 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.584703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7a98f-4a8d-4593-88b9-61c7e49e7781 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.589400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd57bf-21e6-4f31-b5d4-9444d1216707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.590058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd57bf-21e6-4f31-b5d4-9444d1216707 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.590337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd57bf-21e6-4f31-b5d4-9444d1216707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.590609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd57bf-21e6-4f31-b5d4-9444d1216707 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.591368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd57bf-21e6-4f31-b5d4-9444d1216707 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:17.591671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd57bf-21e6-4f31-b5d4-9444d1216707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:17.593296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd57bf-21e6-4f31-b5d4-9444d1216707 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:17.602224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 455/905] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:17.607643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477af31-5abf-4499-a7ea-ad869f7455c7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.617920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477af31-5abf-4499-a7ea-ad869f7455c7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.622516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd4972-25ae-4c19-82a4-c532085b9977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.623289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd4972-25ae-4c19-82a4-c532085b9977 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.623568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd4972-25ae-4c19-82a4-c532085b9977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.623842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd4972-25ae-4c19-82a4-c532085b9977 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.640478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd4972-25ae-4c19-82a4-c532085b9977 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:17.642307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd4972-25ae-4c19-82a4-c532085b9977 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:17.659497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e7fd4972-25ae-4c19-82a4-c532085b9977 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:17.661008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 451/906] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:17.666786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd57bf-21e6-4f31-b5d4-9444d1216707 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.677118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd57bf-21e6-4f31-b5d4-9444d1216707 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.683838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d7bc-c183-4c97-8ade-7f5b7f8624e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.684633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d7bc-c183-4c97-8ade-7f5b7f8624e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.685012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d7bc-c183-4c97-8ade-7f5b7f8624e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.685510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d7bc-c183-4c97-8ade-7f5b7f8624e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.686754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370d7bc-c183-4c97-8ade-7f5b7f8624e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:17.687068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370d7bc-c183-4c97-8ade-7f5b7f8624e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:17.688772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370d7bc-c183-4c97-8ade-7f5b7f8624e5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:17.704145 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 456/907] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:17.710325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd4972-25ae-4c19-82a4-c532085b9977 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.722139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd4972-25ae-4c19-82a4-c532085b9977 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.727056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d49829-4a1a-4c68-bc24-ac995f1f3240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.728102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d49829-4a1a-4c68-bc24-ac995f1f3240 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.728583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d49829-4a1a-4c68-bc24-ac995f1f3240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.729080 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d49829-4a1a-4c68-bc24-ac995f1f3240 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.736890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d49829-4a1a-4c68-bc24-ac995f1f3240 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:17.739135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d49829-4a1a-4c68-bc24-ac995f1f3240 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:17.753655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-41d49829-4a1a-4c68-bc24-ac995f1f3240 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 02:29:17.755292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 452/908] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:17.761496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d7bc-c183-4c97-8ade-7f5b7f8624e5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.772525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d7bc-c183-4c97-8ade-7f5b7f8624e5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.777399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212b70-4e6f-4663-8a62-1f0bdd38ceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.778349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212b70-4e6f-4663-8a62-1f0bdd38ceef admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.778805 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212b70-4e6f-4663-8a62-1f0bdd38ceef admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.779250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25212b70-4e6f-4663-8a62-1f0bdd38ceef admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.780319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212b70-4e6f-4663-8a62-1f0bdd38ceef admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:17.780871 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212b70-4e6f-4663-8a62-1f0bdd38ceef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:17.782824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2af1-e37d-4b87-b122-14549f1a60c8 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.783117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2af1-e37d-4b87-b122-14549f1a60c8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.783397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad2af1-e37d-4b87-b122-14549f1a60c8 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.783673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25212b70-4e6f-4663-8a62-1f0bdd38ceef admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:17.789278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 453/909] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:29:17.790901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a860054-375b-41b9-9ea1-2dd95b3d1085 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.791264 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a860054-375b-41b9-9ea1-2dd95b3d1085 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.791709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a860054-375b-41b9-9ea1-2dd95b3d1085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.803876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 457/910] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:17.809643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212b70-4e6f-4663-8a62-1f0bdd38ceef admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.810551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5a860054-375b-41b9-9ea1-2dd95b3d1085 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:17.811733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5a860054-375b-41b9-9ea1-2dd95b3d1085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:17.820708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 454/911] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:17 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:29:17.822042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25212b70-4e6f-4663-8a62-1f0bdd38ceef admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.828435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d51a8-19e7-496b-badb-62225a8c27b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.829476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d51a8-19e7-496b-badb-62225a8c27b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.829975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d51a8-19e7-496b-badb-62225a8c27b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.830425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d51a8-19e7-496b-badb-62225a8c27b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.842468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d51a8-19e7-496b-badb-62225a8c27b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:17.844490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a860054-375b-41b9-9ea1-2dd95b3d1085 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.845194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d51a8-19e7-496b-badb-62225a8c27b8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:17.853621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a860054-375b-41b9-9ea1-2dd95b3d1085 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.858514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ed956-70e3-4813-9930-615449460006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.859173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ed956-70e3-4813-9930-615449460006 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.859454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ed956-70e3-4813-9930-615449460006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.859730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ed956-70e3-4813-9930-615449460006 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.860500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ed956-70e3-4813-9930-615449460006 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:17.862103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ed956-70e3-4813-9930-615449460006 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:17.865598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-984d51a8-19e7-496b-badb-62225a8c27b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:17.867039 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 458/912] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:17.872639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d51a8-19e7-496b-badb-62225a8c27b8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.888378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d51a8-19e7-496b-badb-62225a8c27b8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.889072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 455/913] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:29:17 2022] POST /identity/v3/services => generated 241 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:29:17.898229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33092a7-1ea3-4766-97ad-fd1be227d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.898902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33092a7-1ea3-4766-97ad-fd1be227d6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.899185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33092a7-1ea3-4766-97ad-fd1be227d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.899459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33092a7-1ea3-4766-97ad-fd1be227d6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.900203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33092a7-1ea3-4766-97ad-fd1be227d6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:17.900529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33092a7-1ea3-4766-97ad-fd1be227d6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:17.902174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33092a7-1ea3-4766-97ad-fd1be227d6d9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:17.915420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 459/914] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:17.921041 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ed956-70e3-4813-9930-615449460006 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.939177 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ed956-70e3-4813-9930-615449460006 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:17.945276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0849c-9655-42c6-b6d2-80cf5fe8fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:17.946556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0849c-9655-42c6-b6d2-80cf5fe8fe0a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:17.947129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0849c-9655-42c6-b6d2-80cf5fe8fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:17.947615 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0849c-9655-42c6-b6d2-80cf5fe8fe0a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:17.957100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0849c-9655-42c6-b6d2-80cf5fe8fe0a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:17.959651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0849c-9655-42c6-b6d2-80cf5fe8fe0a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:17.976985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c8e0849c-9655-42c6-b6d2-80cf5fe8fe0a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:17.978982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 456/915] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:17.985188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33092a7-1ea3-4766-97ad-fd1be227d6d9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:17.996612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33092a7-1ea3-4766-97ad-fd1be227d6d9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:18.001753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bc18e-7d33-4f88-a135-0a60bb155502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:18.002754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bc18e-7d33-4f88-a135-0a60bb155502 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:18.003281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bc18e-7d33-4f88-a135-0a60bb155502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:18.003750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bc18e-7d33-4f88-a135-0a60bb155502 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:18.005003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bc18e-7d33-4f88-a135-0a60bb155502 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:18.006088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bc18e-7d33-4f88-a135-0a60bb155502 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:18.008278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bc18e-7d33-4f88-a135-0a60bb155502 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:18.022554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 460/916] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:18.028838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0849c-9655-42c6-b6d2-80cf5fe8fe0a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:18.040017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0849c-9655-42c6-b6d2-80cf5fe8fe0a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:18.045710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cf22c-f43e-4787-b74e-4a1fb365da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:18.046978 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cf22c-f43e-4787-b74e-4a1fb365da86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:18.047494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cf22c-f43e-4787-b74e-4a1fb365da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:18.048035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cf22c-f43e-4787-b74e-4a1fb365da86 admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/042a422ead5c48f1a428028abe9e419b/roles/1f9e05b1bffc4dc291c6b46b5a84cc3c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:18.050854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cf22c-f43e-4787-b74e-4a1fb365da86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=042a422ead5c48f1a428028abe9e419b, role_id=1f9e05b1bffc4dc291c6b46b5a84cc3c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:18.054461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cf22c-f43e-4787-b74e-4a1fb365da86 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:18.073026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 457/917] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:29:18 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/042a422ead5c48f1a428028abe9e419b/roles/1f9e05b1bffc4dc291c6b46b5a84cc3c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:29:18.513129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5037c97-6434-4450-b6f4-99258d21daf2 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:18.513636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5037c97-6434-4450-b6f4-99258d21daf2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:18.513711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5037c97-6434-4450-b6f4-99258d21daf2 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:18.515710 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 461/918] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:18.521313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514c7ff-2cc3-44e2-ab7c-34df49f39162 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:18.521722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514c7ff-2cc3-44e2-ab7c-34df49f39162 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:18.521885 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514c7ff-2cc3-44e2-ab7c-34df49f39162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:18.540254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9514c7ff-2cc3-44e2-ab7c-34df49f39162 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:18.541465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9514c7ff-2cc3-44e2-ab7c-34df49f39162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:18.604458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 458/919] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:18 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:18.624085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5037c97-6434-4450-b6f4-99258d21daf2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:18.638958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5037c97-6434-4450-b6f4-99258d21daf2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:18.643433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e77537-39fd-4037-b046-248e3cc89778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:18.644224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e77537-39fd-4037-b046-248e3cc89778 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:18.644536 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e77537-39fd-4037-b046-248e3cc89778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:18.644812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e77537-39fd-4037-b046-248e3cc89778 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:18.645477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e77537-39fd-4037-b046-248e3cc89778 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:18.647102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e77537-39fd-4037-b046-248e3cc89778 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:18.658210 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-51e77537-39fd-4037-b046-248e3cc89778 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 07 02:29:18.672421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 462/920] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:29:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:18.673842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514c7ff-2cc3-44e2-ab7c-34df49f39162 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:18.684080 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514c7ff-2cc3-44e2-ab7c-34df49f39162 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:18.688962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf47c-59bd-4815-9d63-8e8f21825725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:18.689841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf47c-59bd-4815-9d63-8e8f21825725 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:18.690336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf47c-59bd-4815-9d63-8e8f21825725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:18.690805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadf47c-59bd-4815-9d63-8e8f21825725 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:18.691716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadf47c-59bd-4815-9d63-8e8f21825725 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:18.692232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadf47c-59bd-4815-9d63-8e8f21825725 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:18.694131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadf47c-59bd-4815-9d63-8e8f21825725 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:18.699954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 459/921] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:29:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:18.705696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e77537-39fd-4037-b046-248e3cc89778 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:18.716384 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e77537-39fd-4037-b046-248e3cc89778 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:18.721130 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e13654-5003-4947-bcc8-0059808a4a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:18.721789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e13654-5003-4947-bcc8-0059808a4a3c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:18.722070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e13654-5003-4947-bcc8-0059808a4a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:18.722394 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e13654-5003-4947-bcc8-0059808a4a3c admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:18.723164 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e13654-5003-4947-bcc8-0059808a4a3c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:18.723476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e13654-5003-4947-bcc8-0059808a4a3c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:18.725732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e13654-5003-4947-bcc8-0059808a4a3c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:18.736076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 463/922] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:29:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:18.737415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf47c-59bd-4815-9d63-8e8f21825725 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:18.747694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadf47c-59bd-4815-9d63-8e8f21825725 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:18.752531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e7faa-80ae-4765-98f2-e1533c15d986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:18.753183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e7faa-80ae-4765-98f2-e1533c15d986 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:18.753469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e7faa-80ae-4765-98f2-e1533c15d986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:18.753794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e7faa-80ae-4765-98f2-e1533c15d986 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:18.754588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e7faa-80ae-4765-98f2-e1533c15d986 admin admin] RBAC: Adding query filter params (interface=public, service_id=9aa347ff944f4145b0c0a8f694e11f74, region_id=RegionOne) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:18.754905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e7faa-80ae-4765-98f2-e1533c15d986 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:18.756710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e7faa-80ae-4765-98f2-e1533c15d986 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:18.766587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 460/923] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Feb 7 02:29:18 2022] GET /identity/v3/endpoints?service_id=9aa347ff944f4145b0c0a8f694e11f74&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:18.767846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e13654-5003-4947-bcc8-0059808a4a3c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:18.778867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e13654-5003-4947-bcc8-0059808a4a3c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:18.783708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc73acf-e5c8-44cc-acd8-4f9aad6f2f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:18.784491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc73acf-e5c8-44cc-acd8-4f9aad6f2f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:18.784784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc73acf-e5c8-44cc-acd8-4f9aad6f2f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:18.785114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc73acf-e5c8-44cc-acd8-4f9aad6f2f27 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:18.785822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc73acf-e5c8-44cc-acd8-4f9aad6f2f27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:18.788135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc73acf-e5c8-44cc-acd8-4f9aad6f2f27 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:18.800671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 464/924] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:29:18 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:29:19.084422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c3136-e57d-499c-9aa1-5d3f96dccbca None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:19.084772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c3136-e57d-499c-9aa1-5d3f96dccbca None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:19.084939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c3136-e57d-499c-9aa1-5d3f96dccbca None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:19.086997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 461/925] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:19.093075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513db5-b9ce-4d24-aced-5a936860d338 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:19.093677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513db5-b9ce-4d24-aced-5a936860d338 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:19.094160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e513db5-b9ce-4d24-aced-5a936860d338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:19.112607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9e513db5-b9ce-4d24-aced-5a936860d338 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:19.114136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9e513db5-b9ce-4d24-aced-5a936860d338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:19.122574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 465/926] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:19 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:19.147197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c3136-e57d-499c-9aa1-5d3f96dccbca None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:19.159722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c3136-e57d-499c-9aa1-5d3f96dccbca None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:19.164376 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdb67a-d14b-42a0-a1a1-e6d32e25fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:19.165417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdb67a-d14b-42a0-a1a1-e6d32e25fbef admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:19.165909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdb67a-d14b-42a0-a1a1-e6d32e25fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:19.166381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdb67a-d14b-42a0-a1a1-e6d32e25fbef admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:19.167246 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdb67a-d14b-42a0-a1a1-e6d32e25fbef admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:19.169081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdb67a-d14b-42a0-a1a1-e6d32e25fbef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:19.180929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-83bdb67a-d14b-42a0-a1a1-e6d32e25fbef admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 07 02:29:19.182736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 462/927] 10.222.0.15 () {56 vars in 1153 bytes} [Mon Feb 7 02:29:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:19.188962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513db5-b9ce-4d24-aced-5a936860d338 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:19.198910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e513db5-b9ce-4d24-aced-5a936860d338 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:19.203984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601d98-fd82-4b0a-a240-336694177656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:19.204934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601d98-fd82-4b0a-a240-336694177656 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:19.205418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601d98-fd82-4b0a-a240-336694177656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:19.205892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601d98-fd82-4b0a-a240-336694177656 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:19.206812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f601d98-fd82-4b0a-a240-336694177656 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:19.207333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f601d98-fd82-4b0a-a240-336694177656 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:19.209743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f601d98-fd82-4b0a-a240-336694177656 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:19.215190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 466/928] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:19.220875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdb67a-d14b-42a0-a1a1-e6d32e25fbef admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:19.230817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdb67a-d14b-42a0-a1a1-e6d32e25fbef admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:19.235650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32827bd-1dc8-423a-9a07-6933a6fdb4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:19.236574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32827bd-1dc8-423a-9a07-6933a6fdb4ce admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:19.237059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32827bd-1dc8-423a-9a07-6933a6fdb4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:19.237550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32827bd-1dc8-423a-9a07-6933a6fdb4ce admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:19.238483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32827bd-1dc8-423a-9a07-6933a6fdb4ce admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:19.238988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32827bd-1dc8-423a-9a07-6933a6fdb4ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:19.240839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32827bd-1dc8-423a-9a07-6933a6fdb4ce admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:19.247094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 463/929] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:19.252662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601d98-fd82-4b0a-a240-336694177656 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:19.263378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601d98-fd82-4b0a-a240-336694177656 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:19.268546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b0636-59bb-4bbb-bb20-7ec1a1379e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:19.269583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b0636-59bb-4bbb-bb20-7ec1a1379e8c admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:19.270099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b0636-59bb-4bbb-bb20-7ec1a1379e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:19.270588 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b0636-59bb-4bbb-bb20-7ec1a1379e8c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:19.272160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b0636-59bb-4bbb-bb20-7ec1a1379e8c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:19.274055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b0636-59bb-4bbb-bb20-7ec1a1379e8c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:19.299505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 467/930] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Feb 7 02:29:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:20.202265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55079b01-3f86-4041-b01e-8ca10a5da8e8 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.202798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55079b01-3f86-4041-b01e-8ca10a5da8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.202798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55079b01-3f86-4041-b01e-8ca10a5da8e8 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.204877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 464/931] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:20.210162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35069c63-8504-4a33-a8e9-0aa457a2ef01 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.210550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35069c63-8504-4a33-a8e9-0aa457a2ef01 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.210733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35069c63-8504-4a33-a8e9-0aa457a2ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.228523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-35069c63-8504-4a33-a8e9-0aa457a2ef01 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:20.229706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-35069c63-8504-4a33-a8e9-0aa457a2ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:20.247637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 468/932] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:20 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:20.270937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55079b01-3f86-4041-b01e-8ca10a5da8e8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.283363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55079b01-3f86-4041-b01e-8ca10a5da8e8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.287836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea9893-dc51-4fc1-bd6d-4e6060c63d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.288706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea9893-dc51-4fc1-bd6d-4e6060c63d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.288986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea9893-dc51-4fc1-bd6d-4e6060c63d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.289258 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea9893-dc51-4fc1-bd6d-4e6060c63d69 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.289924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea9893-dc51-4fc1-bd6d-4e6060c63d69 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.291497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea9893-dc51-4fc1-bd6d-4e6060c63d69 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.303321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-53ea9893-dc51-4fc1-bd6d-4e6060c63d69 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 02:29:20.304728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 465/933] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:20.310675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35069c63-8504-4a33-a8e9-0aa457a2ef01 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.320175 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35069c63-8504-4a33-a8e9-0aa457a2ef01 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.324800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63da64-0910-4d3e-b624-24ea16ecfa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.325447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63da64-0910-4d3e-b624-24ea16ecfa05 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.325984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63da64-0910-4d3e-b624-24ea16ecfa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.326259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63da64-0910-4d3e-b624-24ea16ecfa05 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.326983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63da64-0910-4d3e-b624-24ea16ecfa05 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:20.327286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63da64-0910-4d3e-b624-24ea16ecfa05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.328895 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63da64-0910-4d3e-b624-24ea16ecfa05 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.333964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 469/934] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:20.339327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea9893-dc51-4fc1-bd6d-4e6060c63d69 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.349692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea9893-dc51-4fc1-bd6d-4e6060c63d69 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.354262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de712fa7-100d-40b5-b5e6-9456359a2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.354911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712fa7-100d-40b5-b5e6-9456359a2789 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.355187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712fa7-100d-40b5-b5e6-9456359a2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.355458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de712fa7-100d-40b5-b5e6-9456359a2789 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.356170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de712fa7-100d-40b5-b5e6-9456359a2789 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:20.356511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de712fa7-100d-40b5-b5e6-9456359a2789 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.358099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de712fa7-100d-40b5-b5e6-9456359a2789 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.363489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 466/935] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:20.370485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63da64-0910-4d3e-b624-24ea16ecfa05 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.382697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63da64-0910-4d3e-b624-24ea16ecfa05 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.386295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50a31-1d99-4c10-872c-a06cb0a2647e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.386783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50a31-1d99-4c10-872c-a06cb0a2647e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.387267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c50a31-1d99-4c10-872c-a06cb0a2647e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.389969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 467/936] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:20.393982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5440563-6cae-41d1-8521-5e8151c8a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.394643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5440563-6cae-41d1-8521-5e8151c8a67f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.394921 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5440563-6cae-41d1-8521-5e8151c8a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.395196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5440563-6cae-41d1-8521-5e8151c8a67f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.396051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5440563-6cae-41d1-8521-5e8151c8a67f admin admin] RBAC: Adding query filter params (interface=public, service_id=9da21dab05b34a618ba903ea97582cdd, region_id=RegionOne) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:20.396391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5440563-6cae-41d1-8521-5e8151c8a67f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.397777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35db3-6d34-4c84-b05b-96c369290e7f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.398062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5440563-6cae-41d1-8521-5e8151c8a67f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.398237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35db3-6d34-4c84-b05b-96c369290e7f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.398603 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35db3-6d34-4c84-b05b-96c369290e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.405315 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 470/937] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/endpoints?service_id=9da21dab05b34a618ba903ea97582cdd&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:20.413368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5440563-6cae-41d1-8521-5e8151c8a67f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.417621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d9e35db3-6d34-4c84-b05b-96c369290e7f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:20.418888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d9e35db3-6d34-4c84-b05b-96c369290e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:20.425680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5440563-6cae-41d1-8521-5e8151c8a67f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.429151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 468/938] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:20 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:20.431040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98ac4a-d77f-40a1-8cef-ea63e8194bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.431693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98ac4a-d77f-40a1-8cef-ea63e8194bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.431974 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98ac4a-d77f-40a1-8cef-ea63e8194bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.432249 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98ac4a-d77f-40a1-8cef-ea63e8194bbc admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.432976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98ac4a-d77f-40a1-8cef-ea63e8194bbc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.434560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98ac4a-d77f-40a1-8cef-ea63e8194bbc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.447095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 471/939] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:29:20.453839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35db3-6d34-4c84-b05b-96c369290e7f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.463860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35db3-6d34-4c84-b05b-96c369290e7f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.470248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc3e94-e9b7-42e2-a26e-73e4ee409053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.471381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc3e94-e9b7-42e2-a26e-73e4ee409053 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.471691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc3e94-e9b7-42e2-a26e-73e4ee409053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.472065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc3e94-e9b7-42e2-a26e-73e4ee409053 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.485489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc3e94-e9b7-42e2-a26e-73e4ee409053 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:20.493575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0cdc3e94-e9b7-42e2-a26e-73e4ee409053 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 02:29:20.495207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 469/940] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:20.501271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98ac4a-d77f-40a1-8cef-ea63e8194bbc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.512553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98ac4a-d77f-40a1-8cef-ea63e8194bbc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.517375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702af4-3a41-406d-b068-ffa9da3d4ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.518141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702af4-3a41-406d-b068-ffa9da3d4ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.518417 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702af4-3a41-406d-b068-ffa9da3d4ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.518728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44702af4-3a41-406d-b068-ffa9da3d4ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.519516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44702af4-3a41-406d-b068-ffa9da3d4ee7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:20.519816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44702af4-3a41-406d-b068-ffa9da3d4ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.521622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44702af4-3a41-406d-b068-ffa9da3d4ee7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.531291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 472/941] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:20.537058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc3e94-e9b7-42e2-a26e-73e4ee409053 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.547587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc3e94-e9b7-42e2-a26e-73e4ee409053 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.553337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afb7a8-871a-4dcb-a3e2-81e1f354a923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.554148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afb7a8-871a-4dcb-a3e2-81e1f354a923 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.554425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afb7a8-871a-4dcb-a3e2-81e1f354a923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.554747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afb7a8-871a-4dcb-a3e2-81e1f354a923 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.566769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afb7a8-871a-4dcb-a3e2-81e1f354a923 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.569355 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afb7a8-871a-4dcb-a3e2-81e1f354a923 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.591923 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-14afb7a8-871a-4dcb-a3e2-81e1f354a923 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:20.593608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 470/942] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:20.598865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702af4-3a41-406d-b068-ffa9da3d4ee7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.609701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44702af4-3a41-406d-b068-ffa9da3d4ee7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.614317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af62d7-797b-4ede-a6d9-31ccbc8e707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.615610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af62d7-797b-4ede-a6d9-31ccbc8e707a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.615884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af62d7-797b-4ede-a6d9-31ccbc8e707a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.616154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af62d7-797b-4ede-a6d9-31ccbc8e707a admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.616923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af62d7-797b-4ede-a6d9-31ccbc8e707a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:20.617221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af62d7-797b-4ede-a6d9-31ccbc8e707a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.618812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af62d7-797b-4ede-a6d9-31ccbc8e707a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.633850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 473/943] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:20.639426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afb7a8-871a-4dcb-a3e2-81e1f354a923 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.649600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afb7a8-871a-4dcb-a3e2-81e1f354a923 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.654235 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9c7d-0e49-4a7c-b518-215ea6484c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.655075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9c7d-0e49-4a7c-b518-215ea6484c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.655406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9c7d-0e49-4a7c-b518-215ea6484c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.655683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e9c7d-0e49-4a7c-b518-215ea6484c2c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.664656 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e9c7d-0e49-4a7c-b518-215ea6484c2c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.666804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e9c7d-0e49-4a7c-b518-215ea6484c2c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.681680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-959e9c7d-0e49-4a7c-b518-215ea6484c2c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 07 02:29:20.683161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 471/944] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:20.688751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af62d7-797b-4ede-a6d9-31ccbc8e707a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.698658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af62d7-797b-4ede-a6d9-31ccbc8e707a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.703633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efda10a-0841-4d57-87e8-12a651808086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.704404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efda10a-0841-4d57-87e8-12a651808086 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.704639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efda10a-0841-4d57-87e8-12a651808086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.704964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efda10a-0841-4d57-87e8-12a651808086 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.705799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efda10a-0841-4d57-87e8-12a651808086 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:20.706191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efda10a-0841-4d57-87e8-12a651808086 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.708077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efda10a-0841-4d57-87e8-12a651808086 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.726509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 474/945] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:20.732010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9c7d-0e49-4a7c-b518-215ea6484c2c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.743490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e9c7d-0e49-4a7c-b518-215ea6484c2c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.749039 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff13609-870e-47f3-a500-2e18cfb51e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.749738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13609-870e-47f3-a500-2e18cfb51e1c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.750011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13609-870e-47f3-a500-2e18cfb51e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.750283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13609-870e-47f3-a500-2e18cfb51e1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.759048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff13609-870e-47f3-a500-2e18cfb51e1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.760870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff13609-870e-47f3-a500-2e18cfb51e1c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.770389 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 472/946] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:20.775916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efda10a-0841-4d57-87e8-12a651808086 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.785793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efda10a-0841-4d57-87e8-12a651808086 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.791044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df917d97-ba5a-41ac-a68f-a60e7951aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.791867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df917d97-ba5a-41ac-a68f-a60e7951aaeb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.792144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df917d97-ba5a-41ac-a68f-a60e7951aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.792435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df917d97-ba5a-41ac-a68f-a60e7951aaeb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.803651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df917d97-ba5a-41ac-a68f-a60e7951aaeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.805549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df917d97-ba5a-41ac-a68f-a60e7951aaeb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.822564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-df917d97-ba5a-41ac-a68f-a60e7951aaeb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:20.824047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 475/947] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:20.829755 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff13609-870e-47f3-a500-2e18cfb51e1c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.838902 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff13609-870e-47f3-a500-2e18cfb51e1c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.843705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd57c05-8c57-49a1-b7d4-80bc6ff64a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.844407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd57c05-8c57-49a1-b7d4-80bc6ff64a3f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.844689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd57c05-8c57-49a1-b7d4-80bc6ff64a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.844960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd57c05-8c57-49a1-b7d4-80bc6ff64a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.845708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd57c05-8c57-49a1-b7d4-80bc6ff64a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:20.846010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd57c05-8c57-49a1-b7d4-80bc6ff64a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.847774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd57c05-8c57-49a1-b7d4-80bc6ff64a3f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.862166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 473/948] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:20.868313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df917d97-ba5a-41ac-a68f-a60e7951aaeb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.878549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df917d97-ba5a-41ac-a68f-a60e7951aaeb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.883286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff1e34-adac-45b3-bfb0-10aca5c60091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.884112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff1e34-adac-45b3-bfb0-10aca5c60091 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.884431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff1e34-adac-45b3-bfb0-10aca5c60091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.884706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff1e34-adac-45b3-bfb0-10aca5c60091 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.891885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff1e34-adac-45b3-bfb0-10aca5c60091 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.893904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff1e34-adac-45b3-bfb0-10aca5c60091 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.906909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-faff1e34-adac-45b3-bfb0-10aca5c60091 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:20.908380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 476/949] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:20.914525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd57c05-8c57-49a1-b7d4-80bc6ff64a3f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.924550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd57c05-8c57-49a1-b7d4-80bc6ff64a3f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.929811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b17b23-3d7b-4bfe-a764-fe796d90aa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.930508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17b23-3d7b-4bfe-a764-fe796d90aa89 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.930785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17b23-3d7b-4bfe-a764-fe796d90aa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.931055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17b23-3d7b-4bfe-a764-fe796d90aa89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.931893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b17b23-3d7b-4bfe-a764-fe796d90aa89 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:20.932197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b17b23-3d7b-4bfe-a764-fe796d90aa89 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.934149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b17b23-3d7b-4bfe-a764-fe796d90aa89 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.946438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 474/950] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:20.952512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff1e34-adac-45b3-bfb0-10aca5c60091 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:20.963643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff1e34-adac-45b3-bfb0-10aca5c60091 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:20.968322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed03c91-b7a4-47fc-94d3-5184b723fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:20.969041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed03c91-b7a4-47fc-94d3-5184b723fb2b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:20.969319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed03c91-b7a4-47fc-94d3-5184b723fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:20.969588 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed03c91-b7a4-47fc-94d3-5184b723fb2b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:20.970465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed03c91-b7a4-47fc-94d3-5184b723fb2b admin admin] RBAC: Adding query filter params (role.id=1f9e05b1bffc4dc291c6b46b5a84cc3c, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=042a422ead5c48f1a428028abe9e419b) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:20.970772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed03c91-b7a4-47fc-94d3-5184b723fb2b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:20.972719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed03c91-b7a4-47fc-94d3-5184b723fb2b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:20.979840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 477/951] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:20 2022] GET /identity/v3/role_assignments?user.id=042a422ead5c48f1a428028abe9e419b&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=1f9e05b1bffc4dc291c6b46b5a84cc3c => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:21.135425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c63ac9-2df8-4770-bc96-e2ae37603d2a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.135813 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c63ac9-2df8-4770-bc96-e2ae37603d2a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.136013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c63ac9-2df8-4770-bc96-e2ae37603d2a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.138118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 475/952] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:21.143680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c25cd-d01d-4043-b9c1-84f5deb617cc None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.143960 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c25cd-d01d-4043-b9c1-84f5deb617cc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.144234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c25cd-d01d-4043-b9c1-84f5deb617cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.165151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-293c25cd-d01d-4043-b9c1-84f5deb617cc None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:21.166357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-293c25cd-d01d-4043-b9c1-84f5deb617cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:21.177849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 478/953] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:21 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:21.199720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c63ac9-2df8-4770-bc96-e2ae37603d2a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:21.213301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c63ac9-2df8-4770-bc96-e2ae37603d2a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:21.217819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb099af3-f166-44be-a973-14effc105fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:21.218555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb099af3-f166-44be-a973-14effc105fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.218837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb099af3-f166-44be-a973-14effc105fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.219114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb099af3-f166-44be-a973-14effc105fdd admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.219784 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb099af3-f166-44be-a973-14effc105fdd admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:21.221401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb099af3-f166-44be-a973-14effc105fdd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:21.233145 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-fb099af3-f166-44be-a973-14effc105fdd admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 07 02:29:21.234502 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 476/954] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:29:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:21.240517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c25cd-d01d-4043-b9c1-84f5deb617cc None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:21.249758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c25cd-d01d-4043-b9c1-84f5deb617cc None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:21.254342 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4364d-98fe-4f50-a85f-0ce2a4fb20ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:21.255005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4364d-98fe-4f50-a85f-0ce2a4fb20ce admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.255280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4364d-98fe-4f50-a85f-0ce2a4fb20ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.255586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4364d-98fe-4f50-a85f-0ce2a4fb20ce admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.256306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4364d-98fe-4f50-a85f-0ce2a4fb20ce admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:21.256640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4364d-98fe-4f50-a85f-0ce2a4fb20ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:21.258242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4364d-98fe-4f50-a85f-0ce2a4fb20ce admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:21.268095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 479/955] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:29:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:21.269464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb099af3-f166-44be-a973-14effc105fdd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:21.279852 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb099af3-f166-44be-a973-14effc105fdd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:21.284414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5643a9-2a08-4a22-a589-a67bcc0139ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:21.285063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5643a9-2a08-4a22-a589-a67bcc0139ef admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.285347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5643a9-2a08-4a22-a589-a67bcc0139ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.285628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5643a9-2a08-4a22-a589-a67bcc0139ef admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.286345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5643a9-2a08-4a22-a589-a67bcc0139ef admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:21.287203 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5643a9-2a08-4a22-a589-a67bcc0139ef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:21.288936 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5643a9-2a08-4a22-a589-a67bcc0139ef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:21.294192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 477/956] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Feb 7 02:29:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:21.299675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4364d-98fe-4f50-a85f-0ce2a4fb20ce admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:21.309837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4364d-98fe-4f50-a85f-0ce2a4fb20ce admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:21.314419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a9aa5-e04e-42da-932d-9001a19b1740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:21.315077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a9aa5-e04e-42da-932d-9001a19b1740 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.315355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a9aa5-e04e-42da-932d-9001a19b1740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.315627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a9aa5-e04e-42da-932d-9001a19b1740 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.316421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a9aa5-e04e-42da-932d-9001a19b1740 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:21.318598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a9aa5-e04e-42da-932d-9001a19b1740 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:21.348591 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 480/957] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Feb 7 02:29:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:21.606950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abad85-ad49-4f3c-aef2-b75cde915bc1 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.607288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abad85-ad49-4f3c-aef2-b75cde915bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.607462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abad85-ad49-4f3c-aef2-b75cde915bc1 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.609457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 478/958] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:21.614906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a79c-f908-4068-9645-4c269ad925c4 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.615198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a79c-f908-4068-9645-4c269ad925c4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.615479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659a79c-f908-4068-9645-4c269ad925c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.634165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c659a79c-f908-4068-9645-4c269ad925c4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:21.635414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c659a79c-f908-4068-9645-4c269ad925c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:21.654426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 481/959] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:21 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:21.683273 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abad85-ad49-4f3c-aef2-b75cde915bc1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:21.696495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abad85-ad49-4f3c-aef2-b75cde915bc1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:21.701454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974c0c2-784d-41bc-a267-953c3d520a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:21.702439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c0c2-784d-41bc-a267-953c3d520a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.702927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c0c2-784d-41bc-a267-953c3d520a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.703387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974c0c2-784d-41bc-a267-953c3d520a60 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.704233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974c0c2-784d-41bc-a267-953c3d520a60 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:21.706014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974c0c2-784d-41bc-a267-953c3d520a60 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:21.717456 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a974c0c2-784d-41bc-a267-953c3d520a60 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 07 02:29:21.719179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 479/960] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:21.725337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659a79c-f908-4068-9645-4c269ad925c4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:21.734581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659a79c-f908-4068-9645-4c269ad925c4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:21.739187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b76e6-ca72-4faf-a7f6-2fc5dc4797d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:21.740481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b76e6-ca72-4faf-a7f6-2fc5dc4797d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.740884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b76e6-ca72-4faf-a7f6-2fc5dc4797d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.741240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b76e6-ca72-4faf-a7f6-2fc5dc4797d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.742042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b76e6-ca72-4faf-a7f6-2fc5dc4797d6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:21.742415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b76e6-ca72-4faf-a7f6-2fc5dc4797d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:21.744109 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b76e6-ca72-4faf-a7f6-2fc5dc4797d6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:21.749744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 482/961] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:21.755170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974c0c2-784d-41bc-a267-953c3d520a60 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:21.768390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974c0c2-784d-41bc-a267-953c3d520a60 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:21.773331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c700ac6-6a31-4449-af76-01163bf203dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:21.774247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c700ac6-6a31-4449-af76-01163bf203dd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:21.774749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c700ac6-6a31-4449-af76-01163bf203dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:21.775247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c700ac6-6a31-4449-af76-01163bf203dd admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:21.776175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c700ac6-6a31-4449-af76-01163bf203dd admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:21.776707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c700ac6-6a31-4449-af76-01163bf203dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:21.778920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c700ac6-6a31-4449-af76-01163bf203dd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:21.784947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 480/962] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:22.757042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e17e-c868-470e-9e7d-61c80821f50a None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:22.757550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e17e-c868-470e-9e7d-61c80821f50a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:22.757550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4e17e-c868-470e-9e7d-61c80821f50a None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:22.759606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 483/963] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:22.765295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90bfa6-2a28-4b42-81ff-f309cbb8f7f3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:22.765713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90bfa6-2a28-4b42-81ff-f309cbb8f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:22.765882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90bfa6-2a28-4b42-81ff-f309cbb8f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:22.783940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8e90bfa6-2a28-4b42-81ff-f309cbb8f7f3 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:22.785168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8e90bfa6-2a28-4b42-81ff-f309cbb8f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:22.794532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 481/964] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:22 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:22.817654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4e17e-c868-470e-9e7d-61c80821f50a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:22.830685 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4e17e-c868-470e-9e7d-61c80821f50a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:22.835724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec639e8a-8f36-41ae-afff-4c7b7294f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:22.836546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec639e8a-8f36-41ae-afff-4c7b7294f4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:22.836822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec639e8a-8f36-41ae-afff-4c7b7294f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:22.837092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec639e8a-8f36-41ae-afff-4c7b7294f4c5 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:22.837750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec639e8a-8f36-41ae-afff-4c7b7294f4c5 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:22.839329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec639e8a-8f36-41ae-afff-4c7b7294f4c5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:22.850625 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-ec639e8a-8f36-41ae-afff-4c7b7294f4c5 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 02:29:22.852081 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 484/965] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:22.858097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90bfa6-2a28-4b42-81ff-f309cbb8f7f3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:22.867202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90bfa6-2a28-4b42-81ff-f309cbb8f7f3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:22.871814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69550d8b-f3c8-4810-8e87-e46c363ab1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:22.872499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69550d8b-f3c8-4810-8e87-e46c363ab1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:22.872783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69550d8b-f3c8-4810-8e87-e46c363ab1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:22.873059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69550d8b-f3c8-4810-8e87-e46c363ab1f9 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:22.873849 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69550d8b-f3c8-4810-8e87-e46c363ab1f9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:22.874157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69550d8b-f3c8-4810-8e87-e46c363ab1f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:22.876123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69550d8b-f3c8-4810-8e87-e46c363ab1f9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:22.881868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 482/966] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:22.887396 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec639e8a-8f36-41ae-afff-4c7b7294f4c5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:22.897674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec639e8a-8f36-41ae-afff-4c7b7294f4c5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:22.902290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb0d69-9b5a-405e-a014-5aa8a5978fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:22.902945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0d69-9b5a-405e-a014-5aa8a5978fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:22.903220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0d69-9b5a-405e-a014-5aa8a5978fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:22.903491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb0d69-9b5a-405e-a014-5aa8a5978fe4 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:22.904205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb0d69-9b5a-405e-a014-5aa8a5978fe4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:22.904548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb0d69-9b5a-405e-a014-5aa8a5978fe4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:22.906153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb0d69-9b5a-405e-a014-5aa8a5978fe4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:22.916241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 485/967] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:22.921716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69550d8b-f3c8-4810-8e87-e46c363ab1f9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:22.931871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69550d8b-f3c8-4810-8e87-e46c363ab1f9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:22.936496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f382db2-f26d-42aa-b7b8-162eedfacf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:22.937149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382db2-f26d-42aa-b7b8-162eedfacf53 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:22.937430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382db2-f26d-42aa-b7b8-162eedfacf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:22.937706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382db2-f26d-42aa-b7b8-162eedfacf53 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:22.938464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f382db2-f26d-42aa-b7b8-162eedfacf53 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:22.939470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-8f382db2-f26d-42aa-b7b8-162eedfacf53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:22.939470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:29:22.939470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:29:22.940336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f382db2-f26d-42aa-b7b8-162eedfacf53 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:22.966605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 483/968] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Feb 7 02:29:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:23.250696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bca0e-a4d8-4ed0-8fd5-60f86113b802 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.251054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bca0e-a4d8-4ed0-8fd5-60f86113b802 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.251238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bca0e-a4d8-4ed0-8fd5-60f86113b802 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.253170 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 486/969] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:23.259206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251b239-d114-4188-8de1-798ad5fee2da None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.259522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251b239-d114-4188-8de1-798ad5fee2da None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.259758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251b239-d114-4188-8de1-798ad5fee2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.278446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2251b239-d114-4188-8de1-798ad5fee2da None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:23.279621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2251b239-d114-4188-8de1-798ad5fee2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:23.296214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 484/970] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:23 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:23.319560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bca0e-a4d8-4ed0-8fd5-60f86113b802 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:23.332127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bca0e-a4d8-4ed0-8fd5-60f86113b802 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:23.336637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e242b-e427-48b9-ab35-04fc5525f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:23.337470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e242b-e427-48b9-ab35-04fc5525f92e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.337743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e242b-e427-48b9-ab35-04fc5525f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.338061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e242b-e427-48b9-ab35-04fc5525f92e admin admin] PATH_INFO: `/v3/services/image` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.338725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e242b-e427-48b9-ab35-04fc5525f92e admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:23.340299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e242b-e427-48b9-ab35-04fc5525f92e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:23.351143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-c32e242b-e427-48b9-ab35-04fc5525f92e admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 07 02:29:23.352661 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 487/971] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Feb 7 02:29:23 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:23.358591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251b239-d114-4188-8de1-798ad5fee2da None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:23.368208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251b239-d114-4188-8de1-798ad5fee2da None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:23.372876 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35d64-a8d1-4c3b-8089-a32102a117e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:23.373532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35d64-a8d1-4c3b-8089-a32102a117e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.373857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35d64-a8d1-4c3b-8089-a32102a117e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.374127 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35d64-a8d1-4c3b-8089-a32102a117e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.374897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35d64-a8d1-4c3b-8089-a32102a117e6 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:23.375199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35d64-a8d1-4c3b-8089-a32102a117e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:23.376817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35d64-a8d1-4c3b-8089-a32102a117e6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:23.382652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 485/972] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:23.388132 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e242b-e427-48b9-ab35-04fc5525f92e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:23.398729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e242b-e427-48b9-ab35-04fc5525f92e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:23.403509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70071fe3-a5ca-4fdb-84ae-ed5a380e734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:23.404245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70071fe3-a5ca-4fdb-84ae-ed5a380e734d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.404554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70071fe3-a5ca-4fdb-84ae-ed5a380e734d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.404823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70071fe3-a5ca-4fdb-84ae-ed5a380e734d admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.405605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70071fe3-a5ca-4fdb-84ae-ed5a380e734d admin admin] RBAC: Adding query filter params (type=image) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:23.405906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70071fe3-a5ca-4fdb-84ae-ed5a380e734d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:23.407599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70071fe3-a5ca-4fdb-84ae-ed5a380e734d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:23.413311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 488/973] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:23.688063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685607-74c6-4686-9b19-8cee16ad870c None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.688378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685607-74c6-4686-9b19-8cee16ad870c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.688642 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e685607-74c6-4686-9b19-8cee16ad870c None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.690945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 486/974] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:23.696762 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b853-4838-4140-8f25-8144b1bab43c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.697302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b853-4838-4140-8f25-8144b1bab43c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.697796 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31b853-4838-4140-8f25-8144b1bab43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.716392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3b31b853-4838-4140-8f25-8144b1bab43c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:23.717890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3b31b853-4838-4140-8f25-8144b1bab43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:23.732365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 489/975] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:23 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:29:23.751682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e685607-74c6-4686-9b19-8cee16ad870c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:23.764448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e685607-74c6-4686-9b19-8cee16ad870c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:23.769205 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:23.770616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.771158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.771710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.772734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:23.774864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:23.776581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.common [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 07 02:29:23.799593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.sql.core [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 07 02:29:23.799593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 07 02:29:23.799593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [parameters: {'id': 'e322808f23464519b528a094bb179042', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 07 02:29:23.799593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79276) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 07 02:29:23.805004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e322808f23464519b528a094bb179042.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e322808f23464519b528a094bb179042. Feb 07 02:29:23.806813 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 487/976] 10.222.0.15 () {60 vars in 1161 bytes} [Mon Feb 7 02:29:23 2022] POST /identity/v3/projects => generated 262 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:23.812793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31b853-4838-4140-8f25-8144b1bab43c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:23.822990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31b853-4838-4140-8f25-8144b1bab43c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:23.828177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d99f7-d424-44d4-99ab-843fa29dacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:23.829207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d99f7-d424-44d4-99ab-843fa29dacad admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.829708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d99f7-d424-44d4-99ab-843fa29dacad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.830208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d99f7-d424-44d4-99ab-843fa29dacad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.837550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d99f7-d424-44d4-99ab-843fa29dacad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:23.839703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d99f7-d424-44d4-99ab-843fa29dacad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:23.853565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-e80d99f7-d424-44d4-99ab-843fa29dacad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:23.859647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 490/977] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:23.861446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:23.875453 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa903d52-ce0c-4a13-a0a8-662d99a1ac8d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:23.880540 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683acac-6cd5-4ad5-9c4c-6c8c6056bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:23.881561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683acac-6cd5-4ad5-9c4c-6c8c6056bd4e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:23.882038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683acac-6cd5-4ad5-9c4c-6c8c6056bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:23.882777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683acac-6cd5-4ad5-9c4c-6c8c6056bd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:23.883557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683acac-6cd5-4ad5-9c4c-6c8c6056bd4e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:23.884067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683acac-6cd5-4ad5-9c4c-6c8c6056bd4e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:23.886435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683acac-6cd5-4ad5-9c4c-6c8c6056bd4e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:23.908116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 488/978] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:24.057322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2e61e-3fad-4d61-8ee1-b7bc93e1845d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:24.057510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2e61e-3fad-4d61-8ee1-b7bc93e1845d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:24.057808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2e61e-3fad-4d61-8ee1-b7bc93e1845d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:24.059994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 491/979] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:24.065886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2478d-0ab1-4d32-8a54-1d21b7bb6500 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:24.066184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2478d-0ab1-4d32-8a54-1d21b7bb6500 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:24.066468 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2478d-0ab1-4d32-8a54-1d21b7bb6500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:24.086287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-91f2478d-0ab1-4d32-8a54-1d21b7bb6500 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:24.087819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-91f2478d-0ab1-4d32-8a54-1d21b7bb6500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:24.096009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 489/980] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:24 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:24.121457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2e61e-3fad-4d61-8ee1-b7bc93e1845d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:24.137104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2e61e-3fad-4d61-8ee1-b7bc93e1845d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:24.141480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d5fc6-5a78-4f9d-8f4b-b33a49d6d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:24.142153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5fc6-5a78-4f9d-8f4b-b33a49d6d142 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:24.142433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5fc6-5a78-4f9d-8f4b-b33a49d6d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:24.142707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5fc6-5a78-4f9d-8f4b-b33a49d6d142 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:24.143459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d5fc6-5a78-4f9d-8f4b-b33a49d6d142 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:24.145179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d5fc6-5a78-4f9d-8f4b-b33a49d6d142 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:24.162989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 492/981] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:29:24 2022] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:25.273191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643dc07-3b0d-4ba7-9da8-0c55538b0b43 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.273739 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643dc07-3b0d-4ba7-9da8-0c55538b0b43 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.273739 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643dc07-3b0d-4ba7-9da8-0c55538b0b43 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.275777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 490/982] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:25.281322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5333900-2528-4fde-b593-d00f65f795b7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.281725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5333900-2528-4fde-b593-d00f65f795b7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.281915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5333900-2528-4fde-b593-d00f65f795b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.301396 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d5333900-2528-4fde-b593-d00f65f795b7 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:25.302617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d5333900-2528-4fde-b593-d00f65f795b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:25.320826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 493/983] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:25 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:25.344932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643dc07-3b0d-4ba7-9da8-0c55538b0b43 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:25.357557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643dc07-3b0d-4ba7-9da8-0c55538b0b43 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:25.362031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744e4b-3aa0-47c5-bcb4-1f05aabdca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:25.362824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744e4b-3aa0-47c5-bcb4-1f05aabdca54 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.363106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744e4b-3aa0-47c5-bcb4-1f05aabdca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.363379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744e4b-3aa0-47c5-bcb4-1f05aabdca54 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.364046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0744e4b-3aa0-47c5-bcb4-1f05aabdca54 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:25.365721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0744e4b-3aa0-47c5-bcb4-1f05aabdca54 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:25.377826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e0744e4b-3aa0-47c5-bcb4-1f05aabdca54 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 02:29:25.379439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 491/984] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:25.386428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5333900-2528-4fde-b593-d00f65f795b7 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:25.396493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5333900-2528-4fde-b593-d00f65f795b7 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:25.401171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64143da-3d00-4bde-af05-738ac2051142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:25.401845 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64143da-3d00-4bde-af05-738ac2051142 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.402126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64143da-3d00-4bde-af05-738ac2051142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.402400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64143da-3d00-4bde-af05-738ac2051142 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.403126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64143da-3d00-4bde-af05-738ac2051142 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:25.403437 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64143da-3d00-4bde-af05-738ac2051142 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:25.405075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64143da-3d00-4bde-af05-738ac2051142 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:25.410537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 494/985] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:25.416219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744e4b-3aa0-47c5-bcb4-1f05aabdca54 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:25.426132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744e4b-3aa0-47c5-bcb4-1f05aabdca54 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:25.431282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187d89f-2796-4e26-a1f6-4b4f157852bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:25.431933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187d89f-2796-4e26-a1f6-4b4f157852bf admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.432214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187d89f-2796-4e26-a1f6-4b4f157852bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.432527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187d89f-2796-4e26-a1f6-4b4f157852bf admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.433248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187d89f-2796-4e26-a1f6-4b4f157852bf admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:25.433552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187d89f-2796-4e26-a1f6-4b4f157852bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:25.435141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187d89f-2796-4e26-a1f6-4b4f157852bf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:25.440560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 492/986] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:25.447295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64143da-3d00-4bde-af05-738ac2051142 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:25.457428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64143da-3d00-4bde-af05-738ac2051142 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:25.462049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dac0f8-5567-464b-ae91-6c9b5fa25d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:25.462699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac0f8-5567-464b-ae91-6c9b5fa25d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.462979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac0f8-5567-464b-ae91-6c9b5fa25d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.463257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac0f8-5567-464b-ae91-6c9b5fa25d27 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.464056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dac0f8-5567-464b-ae91-6c9b5fa25d27 admin admin] RBAC: Adding query filter params (interface=admin, service_id=9da21dab05b34a618ba903ea97582cdd, region_id=RegionOne) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:25.464384 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dac0f8-5567-464b-ae91-6c9b5fa25d27 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:25.465985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dac0f8-5567-464b-ae91-6c9b5fa25d27 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:25.474712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 495/987] 10.222.0.15 () {56 vars in 1270 bytes} [Mon Feb 7 02:29:25 2022] GET /identity/v3/endpoints?service_id=9da21dab05b34a618ba903ea97582cdd&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:25.479884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187d89f-2796-4e26-a1f6-4b4f157852bf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:25.493234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187d89f-2796-4e26-a1f6-4b4f157852bf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:25.498010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b1392-7268-46d7-aa63-5fe09267c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:25.498686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b1392-7268-46d7-aa63-5fe09267c81b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.498968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b1392-7268-46d7-aa63-5fe09267c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.499247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b1392-7268-46d7-aa63-5fe09267c81b admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.499946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b1392-7268-46d7-aa63-5fe09267c81b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:25.501569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b1392-7268-46d7-aa63-5fe09267c81b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:25.509300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 493/988] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:29:25 2022] GET /identity/v3/services => generated 1727 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:29:25.662015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10faad-7dc1-4d23-8e84-99e3f2e70310 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.662349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10faad-7dc1-4d23-8e84-99e3f2e70310 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.662538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10faad-7dc1-4d23-8e84-99e3f2e70310 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.664610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 496/989] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:25.670309 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082bb7-d2b0-4e68-a868-280b5e067794 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.670592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082bb7-d2b0-4e68-a868-280b5e067794 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.670867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f082bb7-d2b0-4e68-a868-280b5e067794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.693514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9f082bb7-d2b0-4e68-a868-280b5e067794 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:25.694681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9f082bb7-d2b0-4e68-a868-280b5e067794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:25.703251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 494/990] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:25 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:25.726712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10faad-7dc1-4d23-8e84-99e3f2e70310 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:25.738970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10faad-7dc1-4d23-8e84-99e3f2e70310 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:25.743925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96238fd1-dc00-4033-8855-f73043d9cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:25.744598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96238fd1-dc00-4033-8855-f73043d9cb2d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:25.744875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96238fd1-dc00-4033-8855-f73043d9cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:25.745143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96238fd1-dc00-4033-8855-f73043d9cb2d admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:25.745874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96238fd1-dc00-4033-8855-f73043d9cb2d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:25.747451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96238fd1-dc00-4033-8855-f73043d9cb2d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:25.765068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 497/991] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:29:25 2022] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:26.265505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c98134-78a5-4b50-aa52-457447e0607e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.265884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c98134-78a5-4b50-aa52-457447e0607e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.266078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c98134-78a5-4b50-aa52-457447e0607e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.268048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 495/992] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:26.273722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46068a08-071b-4c2c-9976-9c7fa0b89dcd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.274010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46068a08-071b-4c2c-9976-9c7fa0b89dcd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.274285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46068a08-071b-4c2c-9976-9c7fa0b89dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.295337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-46068a08-071b-4c2c-9976-9c7fa0b89dcd None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:26.297223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-46068a08-071b-4c2c-9976-9c7fa0b89dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:26.314099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 498/993] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:26 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:26.339637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c98134-78a5-4b50-aa52-457447e0607e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:26.353489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c98134-78a5-4b50-aa52-457447e0607e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:26.357960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:26.358616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.358893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.359163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.359885 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:26.361767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:26.377858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.sql.core [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 07 02:29:26.377858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 07 02:29:26.377858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [parameters: {'user_id': '9648026a926e42cf9625836c028b5897', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 07 02:29:26.377858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79276) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 07 02:29:26.383646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 07 02:29:26.385254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 496/994] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:29:26 2022] POST /identity/v3/users => generated 160 bytes in 46 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:26.390856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46068a08-071b-4c2c-9976-9c7fa0b89dcd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:26.400747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46068a08-071b-4c2c-9976-9c7fa0b89dcd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:26.406167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32d942-46a5-46d4-9320-41f841d103b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:26.407340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32d942-46a5-46d4-9320-41f841d103b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.407839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32d942-46a5-46d4-9320-41f841d103b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.408302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32d942-46a5-46d4-9320-41f841d103b9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.416707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32d942-46a5-46d4-9320-41f841d103b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:26.419002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32d942-46a5-46d4-9320-41f841d103b9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:26.433102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-ea32d942-46a5-46d4-9320-41f841d103b9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 07 02:29:26.434853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 499/995] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:26.441189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:26.451906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefcf55-1da4-4854-ae5c-30a034ef36ec admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:26.456933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15da16-6552-4e1f-82c3-0fc466b61a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:26.457842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15da16-6552-4e1f-82c3-0fc466b61a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.458872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15da16-6552-4e1f-82c3-0fc466b61a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.459355 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15da16-6552-4e1f-82c3-0fc466b61a8f admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.460390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15da16-6552-4e1f-82c3-0fc466b61a8f admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:26.460891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15da16-6552-4e1f-82c3-0fc466b61a8f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:26.463240 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15da16-6552-4e1f-82c3-0fc466b61a8f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:26.502940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584839-46af-4134-863c-155331640248 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.503561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584839-46af-4134-863c-155331640248 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.504033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584839-46af-4134-863c-155331640248 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.506320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 500/996] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:26.506961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 497/997] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Feb 7 02:29:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:26.514186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f691b15-84ba-4442-a666-2e500b8bb474 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.514782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f691b15-84ba-4442-a666-2e500b8bb474 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.515250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f691b15-84ba-4442-a666-2e500b8bb474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.536076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8f691b15-84ba-4442-a666-2e500b8bb474 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:26.538242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8f691b15-84ba-4442-a666-2e500b8bb474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:26.547031 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 501/998] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:26 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:26.571989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15da16-6552-4e1f-82c3-0fc466b61a8f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:26.582647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15da16-6552-4e1f-82c3-0fc466b61a8f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:26.588075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c664161-c9a6-427f-ba65-27656067353b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:26.588968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664161-c9a6-427f-ba65-27656067353b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.589253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664161-c9a6-427f-ba65-27656067353b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.589532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c664161-c9a6-427f-ba65-27656067353b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.590212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c664161-c9a6-427f-ba65-27656067353b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:26.591917 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c664161-c9a6-427f-ba65-27656067353b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:26.603743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-9c664161-c9a6-427f-ba65-27656067353b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 07 02:29:26.605861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 498/999] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:26.611716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f691b15-84ba-4442-a666-2e500b8bb474 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:26.621511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f691b15-84ba-4442-a666-2e500b8bb474 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:26.629775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5a101-bb9f-4875-9849-e8af864dc902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:26.631015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5a101-bb9f-4875-9849-e8af864dc902 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.631358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5a101-bb9f-4875-9849-e8af864dc902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.631635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5a101-bb9f-4875-9849-e8af864dc902 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.632389 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5a101-bb9f-4875-9849-e8af864dc902 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:26.632697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5a101-bb9f-4875-9849-e8af864dc902 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:26.634335 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5a101-bb9f-4875-9849-e8af864dc902 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:26.644487 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 502/1000] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:26.646740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c664161-c9a6-427f-ba65-27656067353b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:26.657189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c664161-c9a6-427f-ba65-27656067353b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:26.662102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5ecfd-79d8-4c09-ae9d-26a31982d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:26.662749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5ecfd-79d8-4c09-ae9d-26a31982d783 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.663032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5ecfd-79d8-4c09-ae9d-26a31982d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.663307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5ecfd-79d8-4c09-ae9d-26a31982d783 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.664039 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5ecfd-79d8-4c09-ae9d-26a31982d783 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:26.664380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5ecfd-79d8-4c09-ae9d-26a31982d783 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:26.665988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5ecfd-79d8-4c09-ae9d-26a31982d783 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:26.676446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 499/1001] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:26.678150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5a101-bb9f-4875-9849-e8af864dc902 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:26.688321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5a101-bb9f-4875-9849-e8af864dc902 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:26.696236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801bcfc-5908-491f-be72-a8b13a2396bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:26.696925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801bcfc-5908-491f-be72-a8b13a2396bb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.697198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801bcfc-5908-491f-be72-a8b13a2396bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.697465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801bcfc-5908-491f-be72-a8b13a2396bb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.698424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801bcfc-5908-491f-be72-a8b13a2396bb admin admin] RBAC: Adding query filter params (interface=public, service_id=1b0b8c5eccee49e3bf507ee250026e52, region_id=RegionOne) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:26.698733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801bcfc-5908-491f-be72-a8b13a2396bb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:26.700315 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801bcfc-5908-491f-be72-a8b13a2396bb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:26.706650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 503/1002] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Feb 7 02:29:26 2022] GET /identity/v3/endpoints?service_id=1b0b8c5eccee49e3bf507ee250026e52&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:26.712956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5ecfd-79d8-4c09-ae9d-26a31982d783 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:26.723231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5ecfd-79d8-4c09-ae9d-26a31982d783 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:26.728438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661586a-9277-4f3d-ac71-75024f231490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:26.729091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661586a-9277-4f3d-ac71-75024f231490 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:26.729363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661586a-9277-4f3d-ac71-75024f231490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:26.729634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661586a-9277-4f3d-ac71-75024f231490 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:26.730367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661586a-9277-4f3d-ac71-75024f231490 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:26.731948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661586a-9277-4f3d-ac71-75024f231490 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:26.739388 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 500/1003] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:29:26 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:29:27.833806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c5381-ef80-4924-ba04-f94c2e641771 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:27.834355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c5381-ef80-4924-ba04-f94c2e641771 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:27.834355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c5381-ef80-4924-ba04-f94c2e641771 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:27.836301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 504/1004] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:27.841607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8048a-c160-44a0-8644-d9d89f47947a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:27.842007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8048a-c160-44a0-8644-d9d89f47947a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:27.842164 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8048a-c160-44a0-8644-d9d89f47947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:27.859957 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d0f8048a-c160-44a0-8644-d9d89f47947a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:27.861490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d0f8048a-c160-44a0-8644-d9d89f47947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:27.869863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 501/1005] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:27 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:27.893675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c5381-ef80-4924-ba04-f94c2e641771 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:27.905651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c5381-ef80-4924-ba04-f94c2e641771 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:27.909907 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3821117-7521-4c40-ad85-7d4f27398c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:27.910693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3821117-7521-4c40-ad85-7d4f27398c68 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:27.910968 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3821117-7521-4c40-ad85-7d4f27398c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:27.911238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3821117-7521-4c40-ad85-7d4f27398c68 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:27.911933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3821117-7521-4c40-ad85-7d4f27398c68 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:27.913542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3821117-7521-4c40-ad85-7d4f27398c68 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:27.924495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-e3821117-7521-4c40-ad85-7d4f27398c68 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 07 02:29:27.928547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 505/1006] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Feb 7 02:29:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:27.932281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8048a-c160-44a0-8644-d9d89f47947a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:27.941174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8048a-c160-44a0-8644-d9d89f47947a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:27.946161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8d86-de8b-44d5-b9c2-89593b49104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:27.946804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8d86-de8b-44d5-b9c2-89593b49104c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:27.947082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8d86-de8b-44d5-b9c2-89593b49104c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:27.947356 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a8d86-de8b-44d5-b9c2-89593b49104c admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:27.948061 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a8d86-de8b-44d5-b9c2-89593b49104c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:27.948386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a8d86-de8b-44d5-b9c2-89593b49104c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:27.949961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a8d86-de8b-44d5-b9c2-89593b49104c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:27.959304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 502/1007] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:27.960546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3821117-7521-4c40-ad85-7d4f27398c68 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:27.970293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3821117-7521-4c40-ad85-7d4f27398c68 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:27.974818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31474bcf-0fe7-45ec-b736-1faf0957dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:27.975537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474bcf-0fe7-45ec-b736-1faf0957dd08 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:27.975880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474bcf-0fe7-45ec-b736-1faf0957dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:27.976215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31474bcf-0fe7-45ec-b736-1faf0957dd08 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:27.977053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31474bcf-0fe7-45ec-b736-1faf0957dd08 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:27.977359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31474bcf-0fe7-45ec-b736-1faf0957dd08 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:27.978962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31474bcf-0fe7-45ec-b736-1faf0957dd08 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:27.988185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 506/1008] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Feb 7 02:29:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:27.989355 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8d86-de8b-44d5-b9c2-89593b49104c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:27.999465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a8d86-de8b-44d5-b9c2-89593b49104c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:28.003968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55301d-a2bf-4484-98a9-4abd268a8cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:28.004717 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55301d-a2bf-4484-98a9-4abd268a8cff admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:28.005067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55301d-a2bf-4484-98a9-4abd268a8cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:28.005983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55301d-a2bf-4484-98a9-4abd268a8cff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:28.006798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55301d-a2bf-4484-98a9-4abd268a8cff admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:28.008477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55301d-a2bf-4484-98a9-4abd268a8cff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:28.025109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 503/1009] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Feb 7 02:29:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:28.041511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a165-1f33-4b25-9607-198d539662fe None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:28.041852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a165-1f33-4b25-9607-198d539662fe None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:28.042053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7a165-1f33-4b25-9607-198d539662fe None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:28.043955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 507/1010] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:28.049974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05983623-fb21-457f-8887-bea64f25f371 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:28.050276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05983623-fb21-457f-8887-bea64f25f371 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:28.050526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05983623-fb21-457f-8887-bea64f25f371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:28.070461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-05983623-fb21-457f-8887-bea64f25f371 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:28.071690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-05983623-fb21-457f-8887-bea64f25f371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:28.090373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 504/1011] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:28 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:28.113874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7a165-1f33-4b25-9607-198d539662fe None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:28.127498 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7a165-1f33-4b25-9607-198d539662fe None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:28.132056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdb38-284e-40f1-97ec-99472606c8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:28.132981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdb38-284e-40f1-97ec-99472606c8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:28.133326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdb38-284e-40f1-97ec-99472606c8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:28.133683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdb38-284e-40f1-97ec-99472606c8a8 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:28.134418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdb38-284e-40f1-97ec-99472606c8a8 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:28.136102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdb38-284e-40f1-97ec-99472606c8a8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:28.147438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-a4abdb38-284e-40f1-97ec-99472606c8a8 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 07 02:29:28.152379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 508/1012] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Feb 7 02:29:28 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:28.155194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05983623-fb21-457f-8887-bea64f25f371 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:28.165632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05983623-fb21-457f-8887-bea64f25f371 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:28.170497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329bf5-752d-4aea-acd9-4a780b8f9cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:28.171279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329bf5-752d-4aea-acd9-4a780b8f9cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:28.171623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329bf5-752d-4aea-acd9-4a780b8f9cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:28.172006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329bf5-752d-4aea-acd9-4a780b8f9cf8 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:28.172870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329bf5-752d-4aea-acd9-4a780b8f9cf8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:28.173238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329bf5-752d-4aea-acd9-4a780b8f9cf8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:28.174930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329bf5-752d-4aea-acd9-4a780b8f9cf8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:28.181402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 505/1013] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:28.187028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdb38-284e-40f1-97ec-99472606c8a8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:28.197362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdb38-284e-40f1-97ec-99472606c8a8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:28.202173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc74b2-08b1-4dd2-bec9-9c17271ff9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:28.202816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc74b2-08b1-4dd2-bec9-9c17271ff9cf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:28.203088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc74b2-08b1-4dd2-bec9-9c17271ff9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:28.203360 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc74b2-08b1-4dd2-bec9-9c17271ff9cf admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:28.204061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc74b2-08b1-4dd2-bec9-9c17271ff9cf admin admin] RBAC: Adding query filter params (type=image) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:28.204385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc74b2-08b1-4dd2-bec9-9c17271ff9cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:28.205962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc74b2-08b1-4dd2-bec9-9c17271ff9cf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:28.211291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 509/1014] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:28.217407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329bf5-752d-4aea-acd9-4a780b8f9cf8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:28.227550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329bf5-752d-4aea-acd9-4a780b8f9cf8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:28.232135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065dd26-468f-43ae-b1e7-3dce2fca8b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:28.232810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065dd26-468f-43ae-b1e7-3dce2fca8b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:28.233088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065dd26-468f-43ae-b1e7-3dce2fca8b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:28.233362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065dd26-468f-43ae-b1e7-3dce2fca8b28 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:28.234154 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065dd26-468f-43ae-b1e7-3dce2fca8b28 admin admin] RBAC: Adding query filter params (interface=public, service_id=abe65413295d436b8c9f78f5ba89cb63, region_id=RegionOne) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:28.234461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065dd26-468f-43ae-b1e7-3dce2fca8b28 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:28.236026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065dd26-468f-43ae-b1e7-3dce2fca8b28 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:28.242071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 506/1015] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Feb 7 02:29:28 2022] GET /identity/v3/endpoints?service_id=abe65413295d436b8c9f78f5ba89cb63&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:28.247331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc74b2-08b1-4dd2-bec9-9c17271ff9cf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:28.257140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc74b2-08b1-4dd2-bec9-9c17271ff9cf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:28.261737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bf7f7-3da5-401a-bb25-05a312d094ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:28.262496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf7f7-3da5-401a-bb25-05a312d094ec admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:28.262870 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf7f7-3da5-401a-bb25-05a312d094ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:28.263240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bf7f7-3da5-401a-bb25-05a312d094ec admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:28.264024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bf7f7-3da5-401a-bb25-05a312d094ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:28.265737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bf7f7-3da5-401a-bb25-05a312d094ec admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:28.272772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 510/1016] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:29:28 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:29:28.998591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2832a-2ae3-4cb9-b5c8-46b5b2147a13 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:28.999092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2832a-2ae3-4cb9-b5c8-46b5b2147a13 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:28.999092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2832a-2ae3-4cb9-b5c8-46b5b2147a13 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:29.001026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 507/1017] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:29.006664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198b38-2451-44cc-9360-d89ba876aadd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:29.007052 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198b38-2451-44cc-9360-d89ba876aadd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:29.007227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198b38-2451-44cc-9360-d89ba876aadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:29.025460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-96198b38-2451-44cc-9360-d89ba876aadd None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:29.026641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-96198b38-2451-44cc-9360-d89ba876aadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:29.034446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 511/1018] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:29 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:29.060766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2832a-2ae3-4cb9-b5c8-46b5b2147a13 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:29.072831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2832a-2ae3-4cb9-b5c8-46b5b2147a13 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:29.077434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d12fb-0b99-4268-b84f-8b25e5de98a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:29.078209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d12fb-0b99-4268-b84f-8b25e5de98a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:29.078491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d12fb-0b99-4268-b84f-8b25e5de98a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:29.078767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d12fb-0b99-4268-b84f-8b25e5de98a4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:29.079433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d12fb-0b99-4268-b84f-8b25e5de98a4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:29.081157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d12fb-0b99-4268-b84f-8b25e5de98a4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:29.092007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f32d12fb-0b99-4268-b84f-8b25e5de98a4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 07 02:29:29.093379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 508/1019] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:29.099851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96198b38-2451-44cc-9360-d89ba876aadd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:29.108806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96198b38-2451-44cc-9360-d89ba876aadd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:29.113276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c0e33-579c-4d5e-a4cc-de9e00f3f9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:29.113929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0e33-579c-4d5e-a4cc-de9e00f3f9de admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:29.114207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0e33-579c-4d5e-a4cc-de9e00f3f9de admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:29.114533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0e33-579c-4d5e-a4cc-de9e00f3f9de admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:29.115732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c0e33-579c-4d5e-a4cc-de9e00f3f9de admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:29.116034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c0e33-579c-4d5e-a4cc-de9e00f3f9de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:29.117655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c0e33-579c-4d5e-a4cc-de9e00f3f9de admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:29.122583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 512/1020] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:29.128863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d12fb-0b99-4268-b84f-8b25e5de98a4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:29.138653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d12fb-0b99-4268-b84f-8b25e5de98a4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:29.143208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51c574-555a-4041-b874-ceb1a2076f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:29.143906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c574-555a-4041-b874-ceb1a2076f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:29.144192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c574-555a-4041-b874-ceb1a2076f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:29.144624 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51c574-555a-4041-b874-ceb1a2076f06 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:29.145391 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51c574-555a-4041-b874-ceb1a2076f06 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:29.145721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51c574-555a-4041-b874-ceb1a2076f06 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:29.147419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51c574-555a-4041-b874-ceb1a2076f06 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:29.152377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 509/1021] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Feb 7 02:29:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:29.158077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c0e33-579c-4d5e-a4cc-de9e00f3f9de admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:29.168567 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c0e33-579c-4d5e-a4cc-de9e00f3f9de admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:29.173317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d736a3-1154-4d1c-ba8c-89118baaf89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:29.174102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d736a3-1154-4d1c-ba8c-89118baaf89d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:29.174378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d736a3-1154-4d1c-ba8c-89118baaf89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:29.174647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d736a3-1154-4d1c-ba8c-89118baaf89d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:29.175404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d736a3-1154-4d1c-ba8c-89118baaf89d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:29.177705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d736a3-1154-4d1c-ba8c-89118baaf89d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:29.201592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 513/1022] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Feb 7 02:29:29 2022] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:30.264456 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4c352-de51-49b9-b95d-389f0e4f122b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.264975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4c352-de51-49b9-b95d-389f0e4f122b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.264975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4c352-de51-49b9-b95d-389f0e4f122b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.266908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 510/1023] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:30.272250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3aa97-3963-4857-b1c2-f920b60ec1ea None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.272673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3aa97-3963-4857-b1c2-f920b60ec1ea None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.272836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3aa97-3963-4857-b1c2-f920b60ec1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.289820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d0a3aa97-3963-4857-b1c2-f920b60ec1ea None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:30.290982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d0a3aa97-3963-4857-b1c2-f920b60ec1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:30.308526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 514/1024] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:30 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:30.332326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4c352-de51-49b9-b95d-389f0e4f122b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:30.344326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4c352-de51-49b9-b95d-389f0e4f122b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:30.348594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fd655-834d-438f-81e4-62b4cb18cc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:30.349869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fd655-834d-438f-81e4-62b4cb18cc5e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.350143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fd655-834d-438f-81e4-62b4cb18cc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.350407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fd655-834d-438f-81e4-62b4cb18cc5e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.351579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fd655-834d-438f-81e4-62b4cb18cc5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:30.353270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fd655-834d-438f-81e4-62b4cb18cc5e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:30.354998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 511/1025] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:30.360771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3aa97-3963-4857-b1c2-f920b60ec1ea None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:30.370179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3aa97-3963-4857-b1c2-f920b60ec1ea None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:30.374592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2c197-98ef-4a40-9868-03b6a7e37783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:30.375229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c197-98ef-4a40-9868-03b6a7e37783 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.375502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c197-98ef-4a40-9868-03b6a7e37783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.375771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2c197-98ef-4a40-9868-03b6a7e37783 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.376519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2c197-98ef-4a40-9868-03b6a7e37783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:30.378386 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2c197-98ef-4a40-9868-03b6a7e37783 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:30.412243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 515/1026] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:29:30 2022] POST /identity/v3/projects => generated 311 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:30.494215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adc6ff-a193-4511-b3e8-d7a61be4bae4 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.494584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adc6ff-a193-4511-b3e8-d7a61be4bae4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.494829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adc6ff-a193-4511-b3e8-d7a61be4bae4 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.496910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 512/1027] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:30.502808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0276767-9e9e-4f0b-a194-39c1e16eeb21 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.503101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0276767-9e9e-4f0b-a194-39c1e16eeb21 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.503377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0276767-9e9e-4f0b-a194-39c1e16eeb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.521956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a0276767-9e9e-4f0b-a194-39c1e16eeb21 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:30.523090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a0276767-9e9e-4f0b-a194-39c1e16eeb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:30.586198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 516/1028] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:30 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:30.609883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adc6ff-a193-4511-b3e8-d7a61be4bae4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:30.624233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adc6ff-a193-4511-b3e8-d7a61be4bae4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:30.629232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55070380-8360-4529-bf89-837244c79370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:30.630045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55070380-8360-4529-bf89-837244c79370 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.630329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55070380-8360-4529-bf89-837244c79370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.630605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55070380-8360-4529-bf89-837244c79370 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.631268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55070380-8360-4529-bf89-837244c79370 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:30.632890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55070380-8360-4529-bf89-837244c79370 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:30.644168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-55070380-8360-4529-bf89-837244c79370 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 07 02:29:30.645526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 513/1029] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Feb 7 02:29:30 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:30.651524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0276767-9e9e-4f0b-a194-39c1e16eeb21 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:30.660729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0276767-9e9e-4f0b-a194-39c1e16eeb21 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:30.665832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac86c-f28b-41d6-8163-559f0188cb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:30.666572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac86c-f28b-41d6-8163-559f0188cb01 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.666853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac86c-f28b-41d6-8163-559f0188cb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.667123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac86c-f28b-41d6-8163-559f0188cb01 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.667836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac86c-f28b-41d6-8163-559f0188cb01 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:30.668137 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac86c-f28b-41d6-8163-559f0188cb01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:30.669766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac86c-f28b-41d6-8163-559f0188cb01 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:30.682127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 517/1030] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:30.683589 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55070380-8360-4529-bf89-837244c79370 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:30.693695 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55070380-8360-4529-bf89-837244c79370 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:30.698121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68f9c1-5575-4558-ab0d-2ac83d95bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:30.698761 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68f9c1-5575-4558-ab0d-2ac83d95bddc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.699058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68f9c1-5575-4558-ab0d-2ac83d95bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.699311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68f9c1-5575-4558-ab0d-2ac83d95bddc admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.700013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68f9c1-5575-4558-ab0d-2ac83d95bddc admin admin] RBAC: Adding query filter params (type=image) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:30.700313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68f9c1-5575-4558-ab0d-2ac83d95bddc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:30.702181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a68f9c1-5575-4558-ab0d-2ac83d95bddc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:30.707194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 514/1031] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:30.713469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac86c-f28b-41d6-8163-559f0188cb01 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:30.723214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac86c-f28b-41d6-8163-559f0188cb01 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:30.728236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cccdcd-8363-49da-9e77-5e664200432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:30.729031 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cccdcd-8363-49da-9e77-5e664200432a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:30.729376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cccdcd-8363-49da-9e77-5e664200432a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:30.729721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cccdcd-8363-49da-9e77-5e664200432a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:30.730532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cccdcd-8363-49da-9e77-5e664200432a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:30.732201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cccdcd-8363-49da-9e77-5e664200432a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:30.750099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 518/1032] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Feb 7 02:29:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:29:31.502001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328e48c-657a-4210-8d7b-df87e0bef68d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.502548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328e48c-657a-4210-8d7b-df87e0bef68d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.502548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328e48c-657a-4210-8d7b-df87e0bef68d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.504527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 515/1033] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:31.510209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084a1a-8eb0-4ed9-b6a4-d32fce17ca8f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.510652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084a1a-8eb0-4ed9-b6a4-d32fce17ca8f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.510747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084a1a-8eb0-4ed9-b6a4-d32fce17ca8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.528641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d7084a1a-8eb0-4ed9-b6a4-d32fce17ca8f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:31.529811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d7084a1a-8eb0-4ed9-b6a4-d32fce17ca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:31.548126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 519/1034] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:31.572662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328e48c-657a-4210-8d7b-df87e0bef68d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.585616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328e48c-657a-4210-8d7b-df87e0bef68d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.590171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd79cf-3b9c-4850-a8f7-111475720f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.591072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd79cf-3b9c-4850-a8f7-111475720f88 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.591418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd79cf-3b9c-4850-a8f7-111475720f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.591692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd79cf-3b9c-4850-a8f7-111475720f88 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.602332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd79cf-3b9c-4850-a8f7-111475720f88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:31.609502 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7fdd79cf-3b9c-4850-a8f7-111475720f88 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 02:29:31.610899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 516/1035] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:31.617120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084a1a-8eb0-4ed9-b6a4-d32fce17ca8f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.628916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084a1a-8eb0-4ed9-b6a4-d32fce17ca8f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.634012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25cfd-2010-47d9-9755-a94158e95a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.634739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25cfd-2010-47d9-9755-a94158e95a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.635085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25cfd-2010-47d9-9755-a94158e95a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.635421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25cfd-2010-47d9-9755-a94158e95a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.636251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25cfd-2010-47d9-9755-a94158e95a91 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:31.636641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25cfd-2010-47d9-9755-a94158e95a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:31.638216 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25cfd-2010-47d9-9755-a94158e95a91 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:31.651029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 520/1036] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:31.651954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd79cf-3b9c-4850-a8f7-111475720f88 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.662564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd79cf-3b9c-4850-a8f7-111475720f88 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.667213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a70e0b-8304-48fb-9340-6bbfda8de4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.668026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a70e0b-8304-48fb-9340-6bbfda8de4be admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.668306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a70e0b-8304-48fb-9340-6bbfda8de4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.668607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a70e0b-8304-48fb-9340-6bbfda8de4be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.680215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a70e0b-8304-48fb-9340-6bbfda8de4be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:31.682098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a70e0b-8304-48fb-9340-6bbfda8de4be admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:31.699545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-70a70e0b-8304-48fb-9340-6bbfda8de4be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:31.701164 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 517/1037] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:31.706861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25cfd-2010-47d9-9755-a94158e95a91 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.716797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25cfd-2010-47d9-9755-a94158e95a91 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.721442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a56de-432e-4d22-a949-2a76e89853dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.722185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a56de-432e-4d22-a949-2a76e89853dd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.722532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a56de-432e-4d22-a949-2a76e89853dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.722872 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a56de-432e-4d22-a949-2a76e89853dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.723662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a56de-432e-4d22-a949-2a76e89853dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:31.724109 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a56de-432e-4d22-a949-2a76e89853dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:31.725799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a56de-432e-4d22-a949-2a76e89853dd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:31.737488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 521/1038] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:31.743195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a70e0b-8304-48fb-9340-6bbfda8de4be admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.752910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a70e0b-8304-48fb-9340-6bbfda8de4be admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.758090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f571d2-5d8c-49d5-a1ec-be671aafb82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.758857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f571d2-5d8c-49d5-a1ec-be671aafb82c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.759176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f571d2-5d8c-49d5-a1ec-be671aafb82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.759444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f571d2-5d8c-49d5-a1ec-be671aafb82c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.766708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f571d2-5d8c-49d5-a1ec-be671aafb82c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:31.768711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f571d2-5d8c-49d5-a1ec-be671aafb82c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:31.781880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-40f571d2-5d8c-49d5-a1ec-be671aafb82c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 02:29:31.787459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 518/1039] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:31.788687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a56de-432e-4d22-a949-2a76e89853dd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.798280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a56de-432e-4d22-a949-2a76e89853dd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.803340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f319624-4083-4437-9778-14fb2af300f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.804120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319624-4083-4437-9778-14fb2af300f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.804420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319624-4083-4437-9778-14fb2af300f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.804690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f319624-4083-4437-9778-14fb2af300f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.805517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f319624-4083-4437-9778-14fb2af300f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:31.805818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f319624-4083-4437-9778-14fb2af300f6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:31.808105 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f319624-4083-4437-9778-14fb2af300f6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:31.828375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 522/1040] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:31.831655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f571d2-5d8c-49d5-a1ec-be671aafb82c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.841277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f571d2-5d8c-49d5-a1ec-be671aafb82c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.845805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac644-4d39-4bce-8221-bbfa61f126d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.846502 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac644-4d39-4bce-8221-bbfa61f126d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.846856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac644-4d39-4bce-8221-bbfa61f126d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.847198 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ac644-4d39-4bce-8221-bbfa61f126d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.855450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ac644-4d39-4bce-8221-bbfa61f126d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:31.857211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ac644-4d39-4bce-8221-bbfa61f126d6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:31.867048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 519/1041] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:31.872861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f319624-4083-4437-9778-14fb2af300f6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.882831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f319624-4083-4437-9778-14fb2af300f6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.887375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8beca5-ef96-4577-a88d-9d097a1fb8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.888160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8beca5-ef96-4577-a88d-9d097a1fb8fa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.888467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8beca5-ef96-4577-a88d-9d097a1fb8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.888738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8beca5-ef96-4577-a88d-9d097a1fb8fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.899311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8beca5-ef96-4577-a88d-9d097a1fb8fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:31.901179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8beca5-ef96-4577-a88d-9d097a1fb8fa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:31.918135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-ff8beca5-ef96-4577-a88d-9d097a1fb8fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:31.919511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 523/1042] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:31.924882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac644-4d39-4bce-8221-bbfa61f126d6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.934349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ac644-4d39-4bce-8221-bbfa61f126d6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.938936 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c512-940a-4eee-8152-e8139910a9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.939643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c512-940a-4eee-8152-e8139910a9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.939988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c512-940a-4eee-8152-e8139910a9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.940326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6c512-940a-4eee-8152-e8139910a9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.941135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6c512-940a-4eee-8152-e8139910a9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:31.941514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6c512-940a-4eee-8152-e8139910a9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:31.943183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6c512-940a-4eee-8152-e8139910a9b6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:31.954694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 520/1043] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:31.960140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8beca5-ef96-4577-a88d-9d097a1fb8fa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:31.969837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8beca5-ef96-4577-a88d-9d097a1fb8fa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:31.974838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7e9b-55af-4568-8280-5d7145b41308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:31.975599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7e9b-55af-4568-8280-5d7145b41308 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:31.975874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7e9b-55af-4568-8280-5d7145b41308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:31.976142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7e9b-55af-4568-8280-5d7145b41308 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:31.983018 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7e9b-55af-4568-8280-5d7145b41308 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:31.985005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7e9b-55af-4568-8280-5d7145b41308 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:31.998251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-95bd7e9b-55af-4568-8280-5d7145b41308 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:32.000376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 524/1044] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:32.005501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c512-940a-4eee-8152-e8139910a9b6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:32.015144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6c512-940a-4eee-8152-e8139910a9b6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:32.019574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45179b31-11af-4641-9b7e-09737fb35236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:32.020208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179b31-11af-4641-9b7e-09737fb35236 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:32.020525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179b31-11af-4641-9b7e-09737fb35236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:32.020823 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179b31-11af-4641-9b7e-09737fb35236 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:32.021732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179b31-11af-4641-9b7e-09737fb35236 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:32.022038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179b31-11af-4641-9b7e-09737fb35236 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:32.023840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179b31-11af-4641-9b7e-09737fb35236 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:32.036003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 521/1045] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:32.043359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7e9b-55af-4568-8280-5d7145b41308 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:32.054202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7e9b-55af-4568-8280-5d7145b41308 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:32.058631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac54e7-d585-45b3-94b5-7e5a52ecd943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:32.059269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac54e7-d585-45b3-94b5-7e5a52ecd943 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:32.059547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac54e7-d585-45b3-94b5-7e5a52ecd943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:32.059817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac54e7-d585-45b3-94b5-7e5a52ecd943 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:32.060728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac54e7-d585-45b3-94b5-7e5a52ecd943 admin admin] RBAC: Adding query filter params (role.id=1f9e05b1bffc4dc291c6b46b5a84cc3c, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=904a4e5f54e642eda58c90930b5858f4) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:32.061036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac54e7-d585-45b3-94b5-7e5a52ecd943 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:32.062858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac54e7-d585-45b3-94b5-7e5a52ecd943 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:32.076456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 525/1046] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:32 2022] GET /identity/v3/role_assignments?user.id=904a4e5f54e642eda58c90930b5858f4&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=1f9e05b1bffc4dc291c6b46b5a84cc3c => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:32.691238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477bcd1-069f-47e7-b010-bb09a073d916 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:32.691735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477bcd1-069f-47e7-b010-bb09a073d916 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:32.691833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477bcd1-069f-47e7-b010-bb09a073d916 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:32.694446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 522/1047] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:32.700186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9850f8-4ee8-4260-884b-622b8e5d8337 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:32.701031 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9850f8-4ee8-4260-884b-622b8e5d8337 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:32.701031 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9850f8-4ee8-4260-884b-622b8e5d8337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:32.720173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-cb9850f8-4ee8-4260-884b-622b8e5d8337 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:32.721410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cb9850f8-4ee8-4260-884b-622b8e5d8337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:32.729469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 526/1048] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:32.754064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477bcd1-069f-47e7-b010-bb09a073d916 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:32.766859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477bcd1-069f-47e7-b010-bb09a073d916 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:32.771709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7e98a-6848-4065-8a63-61929cd99a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:32.772511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7e98a-6848-4065-8a63-61929cd99a56 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:32.772794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7e98a-6848-4065-8a63-61929cd99a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:32.773069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7e98a-6848-4065-8a63-61929cd99a56 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:32.774249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7e98a-6848-4065-8a63-61929cd99a56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:32.775924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7e98a-6848-4065-8a63-61929cd99a56 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:32.777718 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 523/1049] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:32.782914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9850f8-4ee8-4260-884b-622b8e5d8337 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:32.792699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9850f8-4ee8-4260-884b-622b8e5d8337 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:32.797862 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d529883-a9bc-42a8-a41f-25208510568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:32.799004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d529883-a9bc-42a8-a41f-25208510568a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:32.799510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d529883-a9bc-42a8-a41f-25208510568a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:32.800020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d529883-a9bc-42a8-a41f-25208510568a admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:32.801272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d529883-a9bc-42a8-a41f-25208510568a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:32.803271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d529883-a9bc-42a8-a41f-25208510568a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:32.832395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 527/1050] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:29:32 2022] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:32.980141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba620-73b9-4059-b8bc-a72184b327b5 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:32.980141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba620-73b9-4059-b8bc-a72184b327b5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:32.980454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ba620-73b9-4059-b8bc-a72184b327b5 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:32.982339 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 524/1051] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:32.987682 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f177a0a-bf5d-46dc-bf33-75b945e39657 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:32.987940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f177a0a-bf5d-46dc-bf33-75b945e39657 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:32.988213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f177a0a-bf5d-46dc-bf33-75b945e39657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:33.007831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0f177a0a-bf5d-46dc-bf33-75b945e39657 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:33.009085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0f177a0a-bf5d-46dc-bf33-75b945e39657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:33.017454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 528/1052] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:29:33.039886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba620-73b9-4059-b8bc-a72184b327b5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:33.052919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ba620-73b9-4059-b8bc-a72184b327b5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:33.057347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015fbaf-15f7-4f6c-af4d-eec53f94b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:33.057981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015fbaf-15f7-4f6c-af4d-eec53f94b1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:33.058258 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015fbaf-15f7-4f6c-af4d-eec53f94b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:33.058525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015fbaf-15f7-4f6c-af4d-eec53f94b1e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:33.067228 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015fbaf-15f7-4f6c-af4d-eec53f94b1e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:33.069583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015fbaf-15f7-4f6c-af4d-eec53f94b1e6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:33.078625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 525/1053] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:33.084445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f177a0a-bf5d-46dc-bf33-75b945e39657 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:33.093470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f177a0a-bf5d-46dc-bf33-75b945e39657 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:33.097978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8699872-ed9a-43a6-bae8-ffa6c3bd1d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:33.098785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8699872-ed9a-43a6-bae8-ffa6c3bd1d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:33.099058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8699872-ed9a-43a6-bae8-ffa6c3bd1d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:33.099322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8699872-ed9a-43a6-bae8-ffa6c3bd1d88 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:33.100523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8699872-ed9a-43a6-bae8-ffa6c3bd1d88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:33.102211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8699872-ed9a-43a6-bae8-ffa6c3bd1d88 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:33.104082 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 529/1054] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:34.279762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824d60b-e229-445d-9f57-32ec45356034 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.280304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824d60b-e229-445d-9f57-32ec45356034 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.280304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824d60b-e229-445d-9f57-32ec45356034 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.282107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 526/1055] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:34.287342 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba620d4-b84a-41f9-a58a-bff8fbb1b9c2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.287736 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba620d4-b84a-41f9-a58a-bff8fbb1b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.287870 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba620d4-b84a-41f9-a58a-bff8fbb1b9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.304940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1ba620d4-b84a-41f9-a58a-bff8fbb1b9c2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:34.306093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1ba620d4-b84a-41f9-a58a-bff8fbb1b9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:34.313578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 530/1056] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:34.337291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824d60b-e229-445d-9f57-32ec45356034 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.349015 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824d60b-e229-445d-9f57-32ec45356034 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.353297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79cade-7db8-49c8-b691-2fddbe86d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.354066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79cade-7db8-49c8-b691-2fddbe86d97b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.354340 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79cade-7db8-49c8-b691-2fddbe86d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.354606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79cade-7db8-49c8-b691-2fddbe86d97b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.364462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79cade-7db8-49c8-b691-2fddbe86d97b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:34.371594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-4b79cade-7db8-49c8-b691-2fddbe86d97b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 02:29:34.372741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 527/1057] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:34.378428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba620d4-b84a-41f9-a58a-bff8fbb1b9c2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.387579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba620d4-b84a-41f9-a58a-bff8fbb1b9c2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.391959 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55e269-dcd8-4baf-afe2-6825a02c8078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.392626 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55e269-dcd8-4baf-afe2-6825a02c8078 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.392901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55e269-dcd8-4baf-afe2-6825a02c8078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.393168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55e269-dcd8-4baf-afe2-6825a02c8078 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.393910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55e269-dcd8-4baf-afe2-6825a02c8078 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:34.394207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55e269-dcd8-4baf-afe2-6825a02c8078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.396398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55e269-dcd8-4baf-afe2-6825a02c8078 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.404069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 531/1058] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:34.409643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79cade-7db8-49c8-b691-2fddbe86d97b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.419635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79cade-7db8-49c8-b691-2fddbe86d97b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.424461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046a133-0615-4f2d-b347-5cffdf44113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.425217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046a133-0615-4f2d-b347-5cffdf44113d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.425496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046a133-0615-4f2d-b347-5cffdf44113d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.425769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046a133-0615-4f2d-b347-5cffdf44113d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.436242 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046a133-0615-4f2d-b347-5cffdf44113d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.438070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046a133-0615-4f2d-b347-5cffdf44113d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.456168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-3046a133-0615-4f2d-b347-5cffdf44113d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:34.457356 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 528/1059] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:34.464006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55e269-dcd8-4baf-afe2-6825a02c8078 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.473860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55e269-dcd8-4baf-afe2-6825a02c8078 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.478584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d69d6b-adef-4d0e-95ba-fa99bf6bfbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.479692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d69d6b-adef-4d0e-95ba-fa99bf6bfbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.480120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d69d6b-adef-4d0e-95ba-fa99bf6bfbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.480433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d69d6b-adef-4d0e-95ba-fa99bf6bfbd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.481165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d69d6b-adef-4d0e-95ba-fa99bf6bfbd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:34.481505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d69d6b-adef-4d0e-95ba-fa99bf6bfbd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.483540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d69d6b-adef-4d0e-95ba-fa99bf6bfbd1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.497929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 532/1060] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:34.503513 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046a133-0615-4f2d-b347-5cffdf44113d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.513866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046a133-0615-4f2d-b347-5cffdf44113d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.518330 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05362aff-beaf-4ef8-92fe-818c34be3bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.519095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05362aff-beaf-4ef8-92fe-818c34be3bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.519369 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05362aff-beaf-4ef8-92fe-818c34be3bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.519634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05362aff-beaf-4ef8-92fe-818c34be3bf9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.526724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05362aff-beaf-4ef8-92fe-818c34be3bf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.528732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05362aff-beaf-4ef8-92fe-818c34be3bf9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.657945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-05362aff-beaf-4ef8-92fe-818c34be3bf9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 02:29:34.659133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 529/1061] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:34.665118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d69d6b-adef-4d0e-95ba-fa99bf6bfbd1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.674806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d69d6b-adef-4d0e-95ba-fa99bf6bfbd1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.679822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b128b-39e5-42a7-bd45-72174b26991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.680514 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b128b-39e5-42a7-bd45-72174b26991a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.680793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b128b-39e5-42a7-bd45-72174b26991a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.681063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b128b-39e5-42a7-bd45-72174b26991a admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.681897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b128b-39e5-42a7-bd45-72174b26991a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:34.682205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b128b-39e5-42a7-bd45-72174b26991a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.684023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b128b-39e5-42a7-bd45-72174b26991a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.701744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 533/1062] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:34.707588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05362aff-beaf-4ef8-92fe-818c34be3bf9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.717354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05362aff-beaf-4ef8-92fe-818c34be3bf9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.721802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d22c-c31a-45c5-a9d6-c7c0f2c43790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.722561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d22c-c31a-45c5-a9d6-c7c0f2c43790 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.722835 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d22c-c31a-45c5-a9d6-c7c0f2c43790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.723099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d22c-c31a-45c5-a9d6-c7c0f2c43790 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.733439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700d22c-c31a-45c5-a9d6-c7c0f2c43790 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.735230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700d22c-c31a-45c5-a9d6-c7c0f2c43790 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.751424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c700d22c-c31a-45c5-a9d6-c7c0f2c43790 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:34.752594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 530/1063] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:34.759034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b128b-39e5-42a7-bd45-72174b26991a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.768715 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b128b-39e5-42a7-bd45-72174b26991a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.773201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa6dfe-0dd5-4f45-a83e-f56a13318cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.773850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa6dfe-0dd5-4f45-a83e-f56a13318cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.774127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa6dfe-0dd5-4f45-a83e-f56a13318cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.774398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa6dfe-0dd5-4f45-a83e-f56a13318cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.775120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa6dfe-0dd5-4f45-a83e-f56a13318cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:34.775419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa6dfe-0dd5-4f45-a83e-f56a13318cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.777049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa6dfe-0dd5-4f45-a83e-f56a13318cf7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.788166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 534/1064] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:34.793928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d22c-c31a-45c5-a9d6-c7c0f2c43790 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.803988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d22c-c31a-45c5-a9d6-c7c0f2c43790 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.808407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6385a-bb51-4191-b873-889c0f9bca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.809167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6385a-bb51-4191-b873-889c0f9bca75 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.809440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6385a-bb51-4191-b873-889c0f9bca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.809706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6385a-bb51-4191-b873-889c0f9bca75 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.816872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6385a-bb51-4191-b873-889c0f9bca75 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.819327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6385a-bb51-4191-b873-889c0f9bca75 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.832111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e0a6385a-bb51-4191-b873-889c0f9bca75 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:34.833486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 531/1065] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:34.838959 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa6dfe-0dd5-4f45-a83e-f56a13318cf7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.849997 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa6dfe-0dd5-4f45-a83e-f56a13318cf7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.855369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2f64a-1192-47d9-9982-69b313307e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.856137 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2f64a-1192-47d9-9982-69b313307e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.856583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2f64a-1192-47d9-9982-69b313307e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.856925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2f64a-1192-47d9-9982-69b313307e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.857832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2f64a-1192-47d9-9982-69b313307e20 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:34.858210 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2f64a-1192-47d9-9982-69b313307e20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.860177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2f64a-1192-47d9-9982-69b313307e20 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.873966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 535/1066] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:34.879867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6385a-bb51-4191-b873-889c0f9bca75 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:34.889484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6385a-bb51-4191-b873-889c0f9bca75 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:34.893895 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5089ce4-913c-451c-907b-023a0b593a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:34.894751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5089ce4-913c-451c-907b-023a0b593a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:34.895026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5089ce4-913c-451c-907b-023a0b593a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:34.895296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5089ce4-913c-451c-907b-023a0b593a2a admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/904a4e5f54e642eda58c90930b5858f4/roles/1f9e05b1bffc4dc291c6b46b5a84cc3c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:34.897506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5089ce4-913c-451c-907b-023a0b593a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=904a4e5f54e642eda58c90930b5858f4, role_id=1f9e05b1bffc4dc291c6b46b5a84cc3c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:34.900093 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5089ce4-913c-451c-907b-023a0b593a2a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:34.913561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 532/1067] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:29:34 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/904a4e5f54e642eda58c90930b5858f4/roles/1f9e05b1bffc4dc291c6b46b5a84cc3c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:29:35.116403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e805515-ee21-4961-afae-e0d0cf430fcc None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:35.116690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e805515-ee21-4961-afae-e0d0cf430fcc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:35.116964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e805515-ee21-4961-afae-e0d0cf430fcc None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:35.118742 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 536/1068] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:35.124106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaca5dc-3efa-45ca-af55-0a36e2b9891a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:35.124424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaca5dc-3efa-45ca-af55-0a36e2b9891a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:35.124733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaca5dc-3efa-45ca-af55-0a36e2b9891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:35.142774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4aaca5dc-3efa-45ca-af55-0a36e2b9891a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:35.143958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4aaca5dc-3efa-45ca-af55-0a36e2b9891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:35.200051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 533/1069] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:35.224952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e805515-ee21-4961-afae-e0d0cf430fcc None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:35.236906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e805515-ee21-4961-afae-e0d0cf430fcc None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:35.241269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87e9a-0192-41a5-a024-3a7a820852c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:35.242041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87e9a-0192-41a5-a024-3a7a820852c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:35.242319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87e9a-0192-41a5-a024-3a7a820852c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:35.242591 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87e9a-0192-41a5-a024-3a7a820852c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:35.252476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c87e9a-0192-41a5-a024-3a7a820852c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:35.259160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-75c87e9a-0192-41a5-a024-3a7a820852c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:35.260317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 537/1070] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:35.266090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaca5dc-3efa-45ca-af55-0a36e2b9891a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:35.275544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaca5dc-3efa-45ca-af55-0a36e2b9891a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:35.280034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43b699-1ce0-4c80-a6f5-851262a6a0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:35.280719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43b699-1ce0-4c80-a6f5-851262a6a0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:35.281000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43b699-1ce0-4c80-a6f5-851262a6a0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:35.281275 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43b699-1ce0-4c80-a6f5-851262a6a0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:35.282031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43b699-1ce0-4c80-a6f5-851262a6a0b6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:35.282336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43b699-1ce0-4c80-a6f5-851262a6a0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:35.283920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43b699-1ce0-4c80-a6f5-851262a6a0b6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:35.292997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 534/1071] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:35.298270 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87e9a-0192-41a5-a024-3a7a820852c4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:35.308445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87e9a-0192-41a5-a024-3a7a820852c4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:35.315338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497cf8d-5a45-4f2d-b2a8-f74694e3034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:35.316181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497cf8d-5a45-4f2d-b2a8-f74694e3034f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:35.316512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497cf8d-5a45-4f2d-b2a8-f74694e3034f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:35.316785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497cf8d-5a45-4f2d-b2a8-f74694e3034f admin admin] PATH_INFO: `/v3/users/0f8c6d1cbef94f9babd92f475e857dee` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:35.330791 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497cf8d-5a45-4f2d-b2a8-f74694e3034f admin admin] RBAC: Authorizing `identity:get_user(user_id=0f8c6d1cbef94f9babd92f475e857dee)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:35.333488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497cf8d-5a45-4f2d-b2a8-f74694e3034f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:35.335116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 538/1072] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:35 2022] GET /identity/v3/users/0f8c6d1cbef94f9babd92f475e857dee => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:35.340616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43b699-1ce0-4c80-a6f5-851262a6a0b6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:35.350632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43b699-1ce0-4c80-a6f5-851262a6a0b6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:35.355043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d606bc-c150-4e49-9145-886165ef8cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:35.355659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d606bc-c150-4e49-9145-886165ef8cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:35.355938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d606bc-c150-4e49-9145-886165ef8cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:35.356208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d606bc-c150-4e49-9145-886165ef8cf5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:35.363636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d606bc-c150-4e49-9145-886165ef8cf5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:35.365460 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d606bc-c150-4e49-9145-886165ef8cf5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:35.378896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 535/1073] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:35 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:29:35.380110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497cf8d-5a45-4f2d-b2a8-f74694e3034f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:35.389383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497cf8d-5a45-4f2d-b2a8-f74694e3034f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:35.393822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2b292-e2a9-45d3-81d4-021cff70a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:35.394643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2b292-e2a9-45d3-81d4-021cff70a9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:35.394917 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2b292-e2a9-45d3-81d4-021cff70a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:35.395185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2b292-e2a9-45d3-81d4-021cff70a9f9 admin admin] PATH_INFO: `/v3/projects/dcad8f14fdc841a4bde0530b53db74d6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:35.396880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2b292-e2a9-45d3-81d4-021cff70a9f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=dcad8f14fdc841a4bde0530b53db74d6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:35.398857 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2b292-e2a9-45d3-81d4-021cff70a9f9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:35.400613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 539/1074] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:29:35 2022] GET /identity/v3/projects/dcad8f14fdc841a4bde0530b53db74d6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:35.406128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d606bc-c150-4e49-9145-886165ef8cf5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:35.415208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d606bc-c150-4e49-9145-886165ef8cf5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:35.419715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf869e4-1675-4c87-af3a-9a7fd2b85749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:35.420304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf869e4-1675-4c87-af3a-9a7fd2b85749 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:35.420609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf869e4-1675-4c87-af3a-9a7fd2b85749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:35.420878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf869e4-1675-4c87-af3a-9a7fd2b85749 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:35.421776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf869e4-1675-4c87-af3a-9a7fd2b85749 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=dcad8f14fdc841a4bde0530b53db74d6, user.id=0f8c6d1cbef94f9babd92f475e857dee) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:35.422079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf869e4-1675-4c87-af3a-9a7fd2b85749 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:35.423847 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf869e4-1675-4c87-af3a-9a7fd2b85749 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:35.436380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 536/1075] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:35 2022] GET /identity/v3/role_assignments?user.id=0f8c6d1cbef94f9babd92f475e857dee&scope.project.id=dcad8f14fdc841a4bde0530b53db74d6&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:37.102031 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc9505-6349-4cc4-af47-ba8a00a76889 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.102572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc9505-6349-4cc4-af47-ba8a00a76889 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.102572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc9505-6349-4cc4-af47-ba8a00a76889 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.104267 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 540/1076] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:37.109722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394ad14-1ad4-4df9-8b1a-f4769c0ed760 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.110141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394ad14-1ad4-4df9-8b1a-f4769c0ed760 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.110252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394ad14-1ad4-4df9-8b1a-f4769c0ed760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.128133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3394ad14-1ad4-4df9-8b1a-f4769c0ed760 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:37.129324 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3394ad14-1ad4-4df9-8b1a-f4769c0ed760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:37.136905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 537/1077] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:37.160578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc9505-6349-4cc4-af47-ba8a00a76889 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.173068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc9505-6349-4cc4-af47-ba8a00a76889 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.177935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d506-904f-4583-9f5b-0208c1726452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.178716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d506-904f-4583-9f5b-0208c1726452 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.178990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d506-904f-4583-9f5b-0208c1726452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.179256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d506-904f-4583-9f5b-0208c1726452 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.189111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8d506-904f-4583-9f5b-0208c1726452 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:37.196541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5ce8d506-904f-4583-9f5b-0208c1726452 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 07 02:29:37.197689 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 541/1078] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:37.203807 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394ad14-1ad4-4df9-8b1a-f4769c0ed760 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.212867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394ad14-1ad4-4df9-8b1a-f4769c0ed760 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.217386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3383-1f8d-4405-9683-464068e934bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.218035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3383-1f8d-4405-9683-464068e934bc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.218317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3383-1f8d-4405-9683-464068e934bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.218595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3383-1f8d-4405-9683-464068e934bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.219348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc3383-1f8d-4405-9683-464068e934bc admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:37.219654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc3383-1f8d-4405-9683-464068e934bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.221301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc3383-1f8d-4405-9683-464068e934bc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.229800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 538/1079] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:37.235418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d506-904f-4583-9f5b-0208c1726452 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.246135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d506-904f-4583-9f5b-0208c1726452 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.250595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81e97-133e-4256-8a4d-7be133ed8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.251358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81e97-133e-4256-8a4d-7be133ed8e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.251636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81e97-133e-4256-8a4d-7be133ed8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.251904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb81e97-133e-4256-8a4d-7be133ed8e4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.262213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb81e97-133e-4256-8a4d-7be133ed8e4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.264025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb81e97-133e-4256-8a4d-7be133ed8e4b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.280085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1fb81e97-133e-4256-8a4d-7be133ed8e4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:37.281261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 542/1080] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:37.287501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3383-1f8d-4405-9683-464068e934bc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.296957 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3383-1f8d-4405-9683-464068e934bc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.301417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c7095-8528-495f-912b-63bc31379c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.302672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c7095-8528-495f-912b-63bc31379c1c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.302951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c7095-8528-495f-912b-63bc31379c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.303222 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c7095-8528-495f-912b-63bc31379c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.303944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c7095-8528-495f-912b-63bc31379c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:37.304246 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c7095-8528-495f-912b-63bc31379c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.305843 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c7095-8528-495f-912b-63bc31379c1c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.317400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 539/1081] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:37.322887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81e97-133e-4256-8a4d-7be133ed8e4b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.333392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb81e97-133e-4256-8a4d-7be133ed8e4b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.338104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f313b84-57c3-4b39-9aa7-e281269db762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.338914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f313b84-57c3-4b39-9aa7-e281269db762 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.339191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f313b84-57c3-4b39-9aa7-e281269db762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.339462 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f313b84-57c3-4b39-9aa7-e281269db762 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.347608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f313b84-57c3-4b39-9aa7-e281269db762 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.350236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f313b84-57c3-4b39-9aa7-e281269db762 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.365164 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6f313b84-57c3-4b39-9aa7-e281269db762 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 07 02:29:37.366267 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 543/1082] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:37.372208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c7095-8528-495f-912b-63bc31379c1c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.381947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c7095-8528-495f-912b-63bc31379c1c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.386855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffd960-9d66-4414-af8e-fe9535483abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.387500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd960-9d66-4414-af8e-fe9535483abe admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.387781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd960-9d66-4414-af8e-fe9535483abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.388120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ffd960-9d66-4414-af8e-fe9535483abe admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.389006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffd960-9d66-4414-af8e-fe9535483abe admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:37.389315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffd960-9d66-4414-af8e-fe9535483abe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.391139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ffd960-9d66-4414-af8e-fe9535483abe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.407774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 540/1083] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:37.414049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f313b84-57c3-4b39-9aa7-e281269db762 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.427777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f313b84-57c3-4b39-9aa7-e281269db762 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.432459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feb957-5213-497c-a7fd-dd24d68778a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.433099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feb957-5213-497c-a7fd-dd24d68778a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.433375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feb957-5213-497c-a7fd-dd24d68778a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.433651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feb957-5213-497c-a7fd-dd24d68778a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.441400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32feb957-5213-497c-a7fd-dd24d68778a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.443143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32feb957-5213-497c-a7fd-dd24d68778a6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.452450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 544/1084] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:37.458458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffd960-9d66-4414-af8e-fe9535483abe admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.467885 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ffd960-9d66-4414-af8e-fe9535483abe admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.472434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bd0b7-516b-4d8c-b9ff-ad5412548419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.473206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bd0b7-516b-4d8c-b9ff-ad5412548419 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.473487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bd0b7-516b-4d8c-b9ff-ad5412548419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.474366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bd0b7-516b-4d8c-b9ff-ad5412548419 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.484176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bd0b7-516b-4d8c-b9ff-ad5412548419 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.486001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bd0b7-516b-4d8c-b9ff-ad5412548419 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.501976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c95bd0b7-516b-4d8c-b9ff-ad5412548419 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:29:37.503127 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 541/1085] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:37.508799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feb957-5213-497c-a7fd-dd24d68778a6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.517543 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feb957-5213-497c-a7fd-dd24d68778a6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.522687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2a4bc-05a9-45d1-b109-296e0ac0d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.523393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2a4bc-05a9-45d1-b109-296e0ac0d666 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.523738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2a4bc-05a9-45d1-b109-296e0ac0d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.524079 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2a4bc-05a9-45d1-b109-296e0ac0d666 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.524905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2a4bc-05a9-45d1-b109-296e0ac0d666 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:37.525287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2a4bc-05a9-45d1-b109-296e0ac0d666 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.526916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2a4bc-05a9-45d1-b109-296e0ac0d666 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.538531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 545/1086] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:37.543772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bd0b7-516b-4d8c-b9ff-ad5412548419 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.553245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bd0b7-516b-4d8c-b9ff-ad5412548419 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.557763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea90f2-cfe3-4032-b35c-6f0a563b3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.558515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea90f2-cfe3-4032-b35c-6f0a563b3793 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.558795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea90f2-cfe3-4032-b35c-6f0a563b3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.559069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea90f2-cfe3-4032-b35c-6f0a563b3793 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.565853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea90f2-cfe3-4032-b35c-6f0a563b3793 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.567767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea90f2-cfe3-4032-b35c-6f0a563b3793 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.580661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-37ea90f2-cfe3-4032-b35c-6f0a563b3793 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:29:37.581806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 542/1087] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:37.587952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2a4bc-05a9-45d1-b109-296e0ac0d666 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.596737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dd4f7-9a8a-4be4-a10c-51e55910e45f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.597021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dd4f7-9a8a-4be4-a10c-51e55910e45f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.597294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dd4f7-9a8a-4be4-a10c-51e55910e45f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.597495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2a4bc-05a9-45d1-b109-296e0ac0d666 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.599606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 543/1088] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:29:37.602604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acee75-6859-4abd-a149-bbde3e5739b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.603238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acee75-6859-4abd-a149-bbde3e5739b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.603516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acee75-6859-4abd-a149-bbde3e5739b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.603787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acee75-6859-4abd-a149-bbde3e5739b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.604332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe9f12-4e0b-4a81-97a0-4b119ba7b178 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.604612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acee75-6859-4abd-a149-bbde3e5739b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:37.604734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe9f12-4e0b-4a81-97a0-4b119ba7b178 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.604898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe9f12-4e0b-4a81-97a0-4b119ba7b178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.604998 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acee75-6859-4abd-a149-bbde3e5739b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.606720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acee75-6859-4abd-a149-bbde3e5739b4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.618886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 546/1089] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:37.622113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-dcbe9f12-4e0b-4a81-97a0-4b119ba7b178 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:37.623287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dcbe9f12-4e0b-4a81-97a0-4b119ba7b178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:37.625497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acee75-6859-4abd-a149-bbde3e5739b4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.631210 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 544/1090] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:29:37.636206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acee75-6859-4abd-a149-bbde3e5739b4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.640655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358182b5-f09d-47b8-837a-c2b7ad8d5c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.641276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358182b5-f09d-47b8-837a-c2b7ad8d5c9a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.641548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358182b5-f09d-47b8-837a-c2b7ad8d5c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.641813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358182b5-f09d-47b8-837a-c2b7ad8d5c9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.642626 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358182b5-f09d-47b8-837a-c2b7ad8d5c9a admin admin] RBAC: Adding query filter params (role.id=1f9e05b1bffc4dc291c6b46b5a84cc3c, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=904a4e5f54e642eda58c90930b5858f4) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:37.642925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358182b5-f09d-47b8-837a-c2b7ad8d5c9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.644772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358182b5-f09d-47b8-837a-c2b7ad8d5c9a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.651748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 547/1091] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/role_assignments?user.id=904a4e5f54e642eda58c90930b5858f4&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=1f9e05b1bffc4dc291c6b46b5a84cc3c => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:37.654154 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe9f12-4e0b-4a81-97a0-4b119ba7b178 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.664047 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe9f12-4e0b-4a81-97a0-4b119ba7b178 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.668958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8e02-cb47-4f73-8b46-118aa7dd481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.669768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8e02-cb47-4f73-8b46-118aa7dd481a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.670045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8e02-cb47-4f73-8b46-118aa7dd481a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.670310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8e02-cb47-4f73-8b46-118aa7dd481a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.682349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8e02-cb47-4f73-8b46-118aa7dd481a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:37.689315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c91a8e02-cb47-4f73-8b46-118aa7dd481a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:37.690576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 545/1092] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:29:37.696900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358182b5-f09d-47b8-837a-c2b7ad8d5c9a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.707349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358182b5-f09d-47b8-837a-c2b7ad8d5c9a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.712623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3f8c1-ed14-4cc6-ac81-58ea48330e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.713306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f8c1-ed14-4cc6-ac81-58ea48330e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.713583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f8c1-ed14-4cc6-ac81-58ea48330e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.713855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3f8c1-ed14-4cc6-ac81-58ea48330e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.714619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3f8c1-ed14-4cc6-ac81-58ea48330e25 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:37.714922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3f8c1-ed14-4cc6-ac81-58ea48330e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.716590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3f8c1-ed14-4cc6-ac81-58ea48330e25 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.731140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 548/1093] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:37.732758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8e02-cb47-4f73-8b46-118aa7dd481a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.743519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8e02-cb47-4f73-8b46-118aa7dd481a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.748076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485816c-3d5d-4b4b-806f-8a253cbabf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.748984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485816c-3d5d-4b4b-806f-8a253cbabf54 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.749255 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485816c-3d5d-4b4b-806f-8a253cbabf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.749519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485816c-3d5d-4b4b-806f-8a253cbabf54 admin admin] PATH_INFO: `/v3/users/0f8c6d1cbef94f9babd92f475e857dee` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.750756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485816c-3d5d-4b4b-806f-8a253cbabf54 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f8c6d1cbef94f9babd92f475e857dee)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.752919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485816c-3d5d-4b4b-806f-8a253cbabf54 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.754579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 546/1094] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/users/0f8c6d1cbef94f9babd92f475e857dee => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:37.760438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3f8c1-ed14-4cc6-ac81-58ea48330e25 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.770973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3f8c1-ed14-4cc6-ac81-58ea48330e25 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.775501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5e2d-934b-4da2-9e08-efbd838772f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.776396 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5e2d-934b-4da2-9e08-efbd838772f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.776680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5e2d-934b-4da2-9e08-efbd838772f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.776951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5e2d-934b-4da2-9e08-efbd838772f3 admin admin] PATH_INFO: `/v3/projects/dcad8f14fdc841a4bde0530b53db74d6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.778148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f5e2d-934b-4da2-9e08-efbd838772f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=dcad8f14fdc841a4bde0530b53db74d6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.780171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f5e2d-934b-4da2-9e08-efbd838772f3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.781905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 549/1095] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:29:37 2022] GET /identity/v3/projects/dcad8f14fdc841a4bde0530b53db74d6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:37.788653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485816c-3d5d-4b4b-806f-8a253cbabf54 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:37.798556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485816c-3d5d-4b4b-806f-8a253cbabf54 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:37.803211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82e320-3b90-455b-af2b-f1f5884a4dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:37.804113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82e320-3b90-455b-af2b-f1f5884a4dac admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:37.804427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82e320-3b90-455b-af2b-f1f5884a4dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:37.804700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82e320-3b90-455b-af2b-f1f5884a4dac admin admin] PATH_INFO: `/v3/projects/dcad8f14fdc841a4bde0530b53db74d6/users/0f8c6d1cbef94f9babd92f475e857dee/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:37.806675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82e320-3b90-455b-af2b-f1f5884a4dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcad8f14fdc841a4bde0530b53db74d6, user_id=0f8c6d1cbef94f9babd92f475e857dee, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:37.809317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82e320-3b90-455b-af2b-f1f5884a4dac admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:37.822844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 547/1096] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:29:37 2022] PUT /identity/v3/projects/dcad8f14fdc841a4bde0530b53db74d6/users/0f8c6d1cbef94f9babd92f475e857dee/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:29:39.999623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3411e-6a66-4195-80e6-ab3affedab6f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:40.000152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3411e-6a66-4195-80e6-ab3affedab6f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:40.000152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3411e-6a66-4195-80e6-ab3affedab6f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:40.001932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 550/1097] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:40.007258 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67369fe3-5a37-4afc-94ce-8b18d4d2bb7d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:40.007648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67369fe3-5a37-4afc-94ce-8b18d4d2bb7d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:40.007801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67369fe3-5a37-4afc-94ce-8b18d4d2bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:40.025792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-67369fe3-5a37-4afc-94ce-8b18d4d2bb7d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:40.026975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-67369fe3-5a37-4afc-94ce-8b18d4d2bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:40.084220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 548/1098] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:40.107452 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3411e-6a66-4195-80e6-ab3affedab6f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:40.119234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3411e-6a66-4195-80e6-ab3affedab6f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:40.123610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a111bda-8aae-4831-83bd-6565a9ed13df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:40.124391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a111bda-8aae-4831-83bd-6565a9ed13df admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:40.124671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a111bda-8aae-4831-83bd-6565a9ed13df admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:40.124936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a111bda-8aae-4831-83bd-6565a9ed13df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:40.135309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a111bda-8aae-4831-83bd-6565a9ed13df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:40.142012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6a111bda-8aae-4831-83bd-6565a9ed13df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:40.143129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 551/1099] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:40.149187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67369fe3-5a37-4afc-94ce-8b18d4d2bb7d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:40.157741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67369fe3-5a37-4afc-94ce-8b18d4d2bb7d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:40.162157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d454be-5da7-4512-af41-23f677208dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:40.162790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d454be-5da7-4512-af41-23f677208dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:40.163065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d454be-5da7-4512-af41-23f677208dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:40.163332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d454be-5da7-4512-af41-23f677208dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:40.164082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d454be-5da7-4512-af41-23f677208dbe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:40.164411 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d454be-5da7-4512-af41-23f677208dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:40.165974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d454be-5da7-4512-af41-23f677208dbe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:40.173867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 549/1100] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:40.179010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a111bda-8aae-4831-83bd-6565a9ed13df admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:40.188793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a111bda-8aae-4831-83bd-6565a9ed13df admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:40.193807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2dd42-6400-421e-ad21-a262c926e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:40.194609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2dd42-6400-421e-ad21-a262c926e516 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:40.194884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2dd42-6400-421e-ad21-a262c926e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:40.195152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2dd42-6400-421e-ad21-a262c926e516 admin admin] PATH_INFO: `/v3/users/0f8c6d1cbef94f9babd92f475e857dee` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:40.196333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2dd42-6400-421e-ad21-a262c926e516 admin admin] RBAC: Authorizing `identity:get_user(user_id=0f8c6d1cbef94f9babd92f475e857dee)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:40.198435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2dd42-6400-421e-ad21-a262c926e516 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:40.199964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 552/1101] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:40 2022] GET /identity/v3/users/0f8c6d1cbef94f9babd92f475e857dee => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:40.205161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d454be-5da7-4512-af41-23f677208dbe admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:40.214720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d454be-5da7-4512-af41-23f677208dbe admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:40.219113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fd59d-2e45-4b0b-869f-132920ecda43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:40.219699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fd59d-2e45-4b0b-869f-132920ecda43 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:40.219973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fd59d-2e45-4b0b-869f-132920ecda43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:40.220242 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fd59d-2e45-4b0b-869f-132920ecda43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:40.227698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fd59d-2e45-4b0b-869f-132920ecda43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:40.229397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fd59d-2e45-4b0b-869f-132920ecda43 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:40.237922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 550/1102] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:40 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:40.243127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2dd42-6400-421e-ad21-a262c926e516 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:40.257206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2dd42-6400-421e-ad21-a262c926e516 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:40.262956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be703697-94f1-4df9-8720-553e7264ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:40.263951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be703697-94f1-4df9-8720-553e7264ddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:40.264319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be703697-94f1-4df9-8720-553e7264ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:40.264723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be703697-94f1-4df9-8720-553e7264ddb2 admin admin] PATH_INFO: `/v3/projects/dcad8f14fdc841a4bde0530b53db74d6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:40.266323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be703697-94f1-4df9-8720-553e7264ddb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=dcad8f14fdc841a4bde0530b53db74d6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:40.268560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be703697-94f1-4df9-8720-553e7264ddb2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:40.270174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 553/1103] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:29:40 2022] GET /identity/v3/projects/dcad8f14fdc841a4bde0530b53db74d6 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:40.276473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fd59d-2e45-4b0b-869f-132920ecda43 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:40.285110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fd59d-2e45-4b0b-869f-132920ecda43 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:40.289625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970d507-7e7a-4a0e-bbad-44b53b1ef234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:40.290243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970d507-7e7a-4a0e-bbad-44b53b1ef234 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:40.290548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970d507-7e7a-4a0e-bbad-44b53b1ef234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:40.290817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970d507-7e7a-4a0e-bbad-44b53b1ef234 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:40.291638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970d507-7e7a-4a0e-bbad-44b53b1ef234 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=dcad8f14fdc841a4bde0530b53db74d6, user.id=0f8c6d1cbef94f9babd92f475e857dee) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:40.291945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970d507-7e7a-4a0e-bbad-44b53b1ef234 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:40.293776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970d507-7e7a-4a0e-bbad-44b53b1ef234 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:40.299297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 551/1104] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:40 2022] GET /identity/v3/role_assignments?user.id=0f8c6d1cbef94f9babd92f475e857dee&scope.project.id=dcad8f14fdc841a4bde0530b53db74d6&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:42.492245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924755-ea26-40be-b999-614a17a307cc None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:42.492844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924755-ea26-40be-b999-614a17a307cc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:42.493224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34924755-ea26-40be-b999-614a17a307cc None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:42.497597 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 554/1105] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:42.503217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3fa80-ff2f-49de-bc87-72522ba168f0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:42.503621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3fa80-ff2f-49de-bc87-72522ba168f0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:42.503767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3fa80-ff2f-49de-bc87-72522ba168f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:42.521160 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d3e3fa80-ff2f-49de-bc87-72522ba168f0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:42.522337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d3e3fa80-ff2f-49de-bc87-72522ba168f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:42.530004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 552/1106] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:42.555747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34924755-ea26-40be-b999-614a17a307cc None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:42.567535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34924755-ea26-40be-b999-614a17a307cc None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:42.571816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9975d74-aa92-4b96-8572-b63cb3fc1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:42.572614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975d74-aa92-4b96-8572-b63cb3fc1783 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:42.572892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975d74-aa92-4b96-8572-b63cb3fc1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:42.573163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9975d74-aa92-4b96-8572-b63cb3fc1783 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:42.574327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9975d74-aa92-4b96-8572-b63cb3fc1783 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:42.576269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9975d74-aa92-4b96-8572-b63cb3fc1783 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:42.577831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 555/1107] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:42.582855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3fa80-ff2f-49de-bc87-72522ba168f0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:42.591493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3fa80-ff2f-49de-bc87-72522ba168f0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:42.596042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f4da-0aa7-4401-97f2-e4d668fae820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:42.596713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f4da-0aa7-4401-97f2-e4d668fae820 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:42.596994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f4da-0aa7-4401-97f2-e4d668fae820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:42.597265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f4da-0aa7-4401-97f2-e4d668fae820 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:42.597989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576f4da-0aa7-4401-97f2-e4d668fae820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:42.600400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576f4da-0aa7-4401-97f2-e4d668fae820 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:42.619868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 553/1108] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:29:42 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:29:44.816637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab4e0a-3f6e-408c-93e4-71cb76e0af39 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:44.817679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab4e0a-3f6e-408c-93e4-71cb76e0af39 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:44.817679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab4e0a-3f6e-408c-93e4-71cb76e0af39 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:44.819429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 556/1109] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:44.824785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939803-9c22-4277-9992-7f2731a19490 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:44.825176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939803-9c22-4277-9992-7f2731a19490 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:44.825334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939803-9c22-4277-9992-7f2731a19490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:44.843357 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-71939803-9c22-4277-9992-7f2731a19490 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:44.844563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-71939803-9c22-4277-9992-7f2731a19490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:44.852100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 554/1110] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:44.875115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab4e0a-3f6e-408c-93e4-71cb76e0af39 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:44.887420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab4e0a-3f6e-408c-93e4-71cb76e0af39 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:44.891719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500db7e6-27ff-48c8-bc2d-8e0c556602c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:44.892570 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500db7e6-27ff-48c8-bc2d-8e0c556602c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:44.892847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500db7e6-27ff-48c8-bc2d-8e0c556602c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:44.893113 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500db7e6-27ff-48c8-bc2d-8e0c556602c4 admin admin] PATH_INFO: `/v3/roles/26c5ad3c42af492f9acc707c03567b73` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:44.894573 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500db7e6-27ff-48c8-bc2d-8e0c556602c4 admin admin] RBAC: Authorizing `identity:get_role(role_id=26c5ad3c42af492f9acc707c03567b73)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:44.896209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-500db7e6-27ff-48c8-bc2d-8e0c556602c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:44.896209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:29:44.896209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:29:44.897105 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500db7e6-27ff-48c8-bc2d-8e0c556602c4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:44.898394 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 557/1111] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:44 2022] GET /identity/v3/roles/26c5ad3c42af492f9acc707c03567b73 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:44.903526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71939803-9c22-4277-9992-7f2731a19490 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:44.912153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71939803-9c22-4277-9992-7f2731a19490 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:44.916620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80214e0-c6c3-4ecb-9478-06f22c624c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:44.917451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80214e0-c6c3-4ecb-9478-06f22c624c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:44.917725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80214e0-c6c3-4ecb-9478-06f22c624c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:44.917999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80214e0-c6c3-4ecb-9478-06f22c624c4e admin admin] PATH_INFO: `/v3/users/b9562bbf02f546ea910f5b8b96ae7b0e` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:44.931512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80214e0-c6c3-4ecb-9478-06f22c624c4e admin admin] RBAC: Authorizing `identity:get_user(user_id=b9562bbf02f546ea910f5b8b96ae7b0e)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:44.933585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80214e0-c6c3-4ecb-9478-06f22c624c4e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:44.935171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 555/1112] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:44 2022] GET /identity/v3/users/b9562bbf02f546ea910f5b8b96ae7b0e => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:44.940474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500db7e6-27ff-48c8-bc2d-8e0c556602c4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:44.950200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500db7e6-27ff-48c8-bc2d-8e0c556602c4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:44.954886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b4444-0c15-4072-8e03-07e16b0ec1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:44.955483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4444-0c15-4072-8e03-07e16b0ec1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:44.955762 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4444-0c15-4072-8e03-07e16b0ec1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:44.956033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b4444-0c15-4072-8e03-07e16b0ec1d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:44.963463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b4444-0c15-4072-8e03-07e16b0ec1d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:44.965191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b4444-0c15-4072-8e03-07e16b0ec1d2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:44.973725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 558/1113] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:29:44.978823 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80214e0-c6c3-4ecb-9478-06f22c624c4e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:44.987802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80214e0-c6c3-4ecb-9478-06f22c624c4e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:44.992726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276440d-f9a4-43a0-acf8-ff9596d187d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:44.993512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276440d-f9a4-43a0-acf8-ff9596d187d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:44.993788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276440d-f9a4-43a0-acf8-ff9596d187d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:44.994054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276440d-f9a4-43a0-acf8-ff9596d187d1 admin admin] PATH_INFO: `/v3/projects/dcad8f14fdc841a4bde0530b53db74d6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:44.995212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276440d-f9a4-43a0-acf8-ff9596d187d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=dcad8f14fdc841a4bde0530b53db74d6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:44.997199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276440d-f9a4-43a0-acf8-ff9596d187d1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:44.998800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 556/1114] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:29:44 2022] GET /identity/v3/projects/dcad8f14fdc841a4bde0530b53db74d6 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:45.004233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b4444-0c15-4072-8e03-07e16b0ec1d2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:45.013161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b4444-0c15-4072-8e03-07e16b0ec1d2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:45.017660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd422eb-e214-4b8f-b255-be3990ada51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:45.018292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd422eb-e214-4b8f-b255-be3990ada51a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:45.018572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd422eb-e214-4b8f-b255-be3990ada51a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:45.018847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd422eb-e214-4b8f-b255-be3990ada51a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:45.019660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd422eb-e214-4b8f-b255-be3990ada51a admin admin] RBAC: Adding query filter params (role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=dcad8f14fdc841a4bde0530b53db74d6, user.id=b9562bbf02f546ea910f5b8b96ae7b0e) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:45.019969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd422eb-e214-4b8f-b255-be3990ada51a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:45.021774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd422eb-e214-4b8f-b255-be3990ada51a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:45.026883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 559/1115] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:45 2022] GET /identity/v3/role_assignments?user.id=b9562bbf02f546ea910f5b8b96ae7b0e&scope.project.id=dcad8f14fdc841a4bde0530b53db74d6&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:47.197719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d466ca-bcb4-42ca-a9ce-adde71fa5857 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:47.198233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d466ca-bcb4-42ca-a9ce-adde71fa5857 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:47.198327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d466ca-bcb4-42ca-a9ce-adde71fa5857 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:47.200028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 557/1116] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:47.205590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43704d01-48d2-4c14-b97b-8f0b2a4f9225 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:47.205965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43704d01-48d2-4c14-b97b-8f0b2a4f9225 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:47.206126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43704d01-48d2-4c14-b97b-8f0b2a4f9225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:47.224208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-43704d01-48d2-4c14-b97b-8f0b2a4f9225 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:47.225392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-43704d01-48d2-4c14-b97b-8f0b2a4f9225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:47.232850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 560/1117] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:47.254891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d466ca-bcb4-42ca-a9ce-adde71fa5857 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:47.266775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d466ca-bcb4-42ca-a9ce-adde71fa5857 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:47.272383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c295510-1a57-4fe0-b7d5-df5ebc6240f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:47.273201 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c295510-1a57-4fe0-b7d5-df5ebc6240f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:47.273478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c295510-1a57-4fe0-b7d5-df5ebc6240f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:47.273747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c295510-1a57-4fe0-b7d5-df5ebc6240f3 admin admin] PATH_INFO: `/v3/roles/26c5ad3c42af492f9acc707c03567b73` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:47.275212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c295510-1a57-4fe0-b7d5-df5ebc6240f3 admin admin] RBAC: Authorizing `identity:get_role(role_id=26c5ad3c42af492f9acc707c03567b73)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:47.276208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-0c295510-1a57-4fe0-b7d5-df5ebc6240f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:29:47.276208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:29:47.276208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:29:47.277105 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c295510-1a57-4fe0-b7d5-df5ebc6240f3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:47.278420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 558/1118] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:47 2022] GET /identity/v3/roles/26c5ad3c42af492f9acc707c03567b73 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:47.283642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43704d01-48d2-4c14-b97b-8f0b2a4f9225 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:47.292851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43704d01-48d2-4c14-b97b-8f0b2a4f9225 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:47.297226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37e193-f956-48ac-b1b6-12777f7da7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:47.298048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37e193-f956-48ac-b1b6-12777f7da7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:47.298319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37e193-f956-48ac-b1b6-12777f7da7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:47.298584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37e193-f956-48ac-b1b6-12777f7da7e2 admin admin] PATH_INFO: `/v3/users/b9562bbf02f546ea910f5b8b96ae7b0e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:47.299761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37e193-f956-48ac-b1b6-12777f7da7e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9562bbf02f546ea910f5b8b96ae7b0e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:47.301951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37e193-f956-48ac-b1b6-12777f7da7e2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:47.303589 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 561/1119] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:47 2022] GET /identity/v3/users/b9562bbf02f546ea910f5b8b96ae7b0e => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:47.308495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c295510-1a57-4fe0-b7d5-df5ebc6240f3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:47.317613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c295510-1a57-4fe0-b7d5-df5ebc6240f3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:47.322061 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b604d-0a11-4e58-aa3f-1ff854b433ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:47.322833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b604d-0a11-4e58-aa3f-1ff854b433ec admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:47.323112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b604d-0a11-4e58-aa3f-1ff854b433ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:47.323382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b604d-0a11-4e58-aa3f-1ff854b433ec admin admin] PATH_INFO: `/v3/projects/dcad8f14fdc841a4bde0530b53db74d6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:47.324568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b604d-0a11-4e58-aa3f-1ff854b433ec admin admin] RBAC: Authorizing `identity:get_project(project_id=dcad8f14fdc841a4bde0530b53db74d6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:47.326773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b604d-0a11-4e58-aa3f-1ff854b433ec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:47.328385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 559/1120] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:29:47 2022] GET /identity/v3/projects/dcad8f14fdc841a4bde0530b53db74d6 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:29:47.333951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37e193-f956-48ac-b1b6-12777f7da7e2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:47.345310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37e193-f956-48ac-b1b6-12777f7da7e2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:47.350960 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c96a4d-ecf7-4d8b-a06c-7aeaeafc006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:47.351873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96a4d-ecf7-4d8b-a06c-7aeaeafc006d admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:47.352146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96a4d-ecf7-4d8b-a06c-7aeaeafc006d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:47.352445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96a4d-ecf7-4d8b-a06c-7aeaeafc006d admin admin] PATH_INFO: `/v3/projects/dcad8f14fdc841a4bde0530b53db74d6/users/b9562bbf02f546ea910f5b8b96ae7b0e/roles/26c5ad3c42af492f9acc707c03567b73` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:47.354612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c96a4d-ecf7-4d8b-a06c-7aeaeafc006d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcad8f14fdc841a4bde0530b53db74d6, user_id=b9562bbf02f546ea910f5b8b96ae7b0e, role_id=26c5ad3c42af492f9acc707c03567b73)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:47.357221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c96a4d-ecf7-4d8b-a06c-7aeaeafc006d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:47.370163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 562/1121] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:29:47 2022] PUT /identity/v3/projects/dcad8f14fdc841a4bde0530b53db74d6/users/b9562bbf02f546ea910f5b8b96ae7b0e/roles/26c5ad3c42af492f9acc707c03567b73 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:29:49.527000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33416d-d2ad-42fa-84ae-bab5fe5435ad None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:49.527545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33416d-d2ad-42fa-84ae-bab5fe5435ad None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:49.527545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33416d-d2ad-42fa-84ae-bab5fe5435ad None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:49.529347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 560/1122] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:49.534591 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1542-7444-419d-9466-220b501cb1cc None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:49.535017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1542-7444-419d-9466-220b501cb1cc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:49.535169 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f1542-7444-419d-9466-220b501cb1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:49.553695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-059f1542-7444-419d-9466-220b501cb1cc None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:49.554860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-059f1542-7444-419d-9466-220b501cb1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:49.608557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 563/1123] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:49.633173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33416d-d2ad-42fa-84ae-bab5fe5435ad None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:49.645009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33416d-d2ad-42fa-84ae-bab5fe5435ad None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:49.649268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6416-164c-43a0-8868-61786d40434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:49.650082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6416-164c-43a0-8868-61786d40434f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:49.650358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6416-164c-43a0-8868-61786d40434f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:49.650628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6416-164c-43a0-8868-61786d40434f admin admin] PATH_INFO: `/v3/roles/26c5ad3c42af492f9acc707c03567b73` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:49.652077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6416-164c-43a0-8868-61786d40434f admin admin] RBAC: Authorizing `identity:get_role(role_id=26c5ad3c42af492f9acc707c03567b73)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:49.653693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6416-164c-43a0-8868-61786d40434f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:49.654995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 561/1124] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:49 2022] GET /identity/v3/roles/26c5ad3c42af492f9acc707c03567b73 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:49.660200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f1542-7444-419d-9466-220b501cb1cc None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:49.668836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f1542-7444-419d-9466-220b501cb1cc None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:49.673376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0347502-db4c-4948-97eb-4c7d497c3163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:49.674221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0347502-db4c-4948-97eb-4c7d497c3163 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:49.674497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0347502-db4c-4948-97eb-4c7d497c3163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:49.674768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0347502-db4c-4948-97eb-4c7d497c3163 admin admin] PATH_INFO: `/v3/users/b9562bbf02f546ea910f5b8b96ae7b0e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:49.675976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0347502-db4c-4948-97eb-4c7d497c3163 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9562bbf02f546ea910f5b8b96ae7b0e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:49.678610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0347502-db4c-4948-97eb-4c7d497c3163 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:49.680172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 564/1125] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:49 2022] GET /identity/v3/users/b9562bbf02f546ea910f5b8b96ae7b0e => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:49.685348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6416-164c-43a0-8868-61786d40434f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:49.695234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6416-164c-43a0-8868-61786d40434f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:49.699654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a31d88-a4ac-4446-a929-c3ae86d6a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:49.700256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a31d88-a4ac-4446-a929-c3ae86d6a555 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:49.700823 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a31d88-a4ac-4446-a929-c3ae86d6a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:49.701096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a31d88-a4ac-4446-a929-c3ae86d6a555 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:49.709179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a31d88-a4ac-4446-a929-c3ae86d6a555 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:49.710863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a31d88-a4ac-4446-a929-c3ae86d6a555 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:49.719398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 562/1126] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:49.725156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0347502-db4c-4948-97eb-4c7d497c3163 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:49.734398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0347502-db4c-4948-97eb-4c7d497c3163 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:49.738832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa800559-e5da-48c7-92ba-9e1b86ffaebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:49.739628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800559-e5da-48c7-92ba-9e1b86ffaebc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:49.739906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800559-e5da-48c7-92ba-9e1b86ffaebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:49.740178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa800559-e5da-48c7-92ba-9e1b86ffaebc admin admin] PATH_INFO: `/v3/projects/dcad8f14fdc841a4bde0530b53db74d6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:49.741368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa800559-e5da-48c7-92ba-9e1b86ffaebc admin admin] RBAC: Authorizing `identity:get_project(project_id=dcad8f14fdc841a4bde0530b53db74d6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:49.743326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa800559-e5da-48c7-92ba-9e1b86ffaebc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:49.745072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 565/1127] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:29:49 2022] GET /identity/v3/projects/dcad8f14fdc841a4bde0530b53db74d6 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:49.750174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a31d88-a4ac-4446-a929-c3ae86d6a555 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:49.758978 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a31d88-a4ac-4446-a929-c3ae86d6a555 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:49.763406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53391cf5-e89f-471c-8fa5-fefb66ceefca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:49.764002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391cf5-e89f-471c-8fa5-fefb66ceefca admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:49.764276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391cf5-e89f-471c-8fa5-fefb66ceefca admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:49.764586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53391cf5-e89f-471c-8fa5-fefb66ceefca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:49.765388 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391cf5-e89f-471c-8fa5-fefb66ceefca admin admin] RBAC: Adding query filter params (role.id=26c5ad3c42af492f9acc707c03567b73, scope.project.id=dcad8f14fdc841a4bde0530b53db74d6, user.id=b9562bbf02f546ea910f5b8b96ae7b0e) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:49.765688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391cf5-e89f-471c-8fa5-fefb66ceefca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:49.767428 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53391cf5-e89f-471c-8fa5-fefb66ceefca admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:49.773630 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 563/1128] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:49 2022] GET /identity/v3/role_assignments?user.id=b9562bbf02f546ea910f5b8b96ae7b0e&scope.project.id=dcad8f14fdc841a4bde0530b53db74d6&role.id=26c5ad3c42af492f9acc707c03567b73 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:51.989392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602ed27-9d6d-41d0-bfad-43e6a099600d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:51.989882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602ed27-9d6d-41d0-bfad-43e6a099600d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:51.989882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602ed27-9d6d-41d0-bfad-43e6a099600d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:51.991637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 566/1129] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:51.996915 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d88f-766d-442a-80d0-082c6ec4a188 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:51.997307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d88f-766d-442a-80d0-082c6ec4a188 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:51.997459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961d88f-766d-442a-80d0-082c6ec4a188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:52.015182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8961d88f-766d-442a-80d0-082c6ec4a188 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:52.016332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8961d88f-766d-442a-80d0-082c6ec4a188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:52.023847 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 564/1130] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:52.047355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602ed27-9d6d-41d0-bfad-43e6a099600d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:52.059698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602ed27-9d6d-41d0-bfad-43e6a099600d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:52.064003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb94fe-ce34-4fbe-b8b3-3bce191afe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:52.064789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb94fe-ce34-4fbe-b8b3-3bce191afe0e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:52.065075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb94fe-ce34-4fbe-b8b3-3bce191afe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:52.065347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb94fe-ce34-4fbe-b8b3-3bce191afe0e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:52.066507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb94fe-ce34-4fbe-b8b3-3bce191afe0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:52.068811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb94fe-ce34-4fbe-b8b3-3bce191afe0e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:52.070348 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 567/1131] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:52.075358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961d88f-766d-442a-80d0-082c6ec4a188 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:52.084118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961d88f-766d-442a-80d0-082c6ec4a188 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:52.088576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfc811-c4e8-4f43-8981-6c8296b90955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:52.089193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfc811-c4e8-4f43-8981-6c8296b90955 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:52.089467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfc811-c4e8-4f43-8981-6c8296b90955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:52.089735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfc811-c4e8-4f43-8981-6c8296b90955 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:52.090467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfc811-c4e8-4f43-8981-6c8296b90955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:52.092317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfc811-c4e8-4f43-8981-6c8296b90955 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:52.117295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 565/1132] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:29:52 2022] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:54.320235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb30c4-707c-4c5c-ae2c-6d8ef97ca57f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:54.320804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb30c4-707c-4c5c-ae2c-6d8ef97ca57f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:54.320804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb30c4-707c-4c5c-ae2c-6d8ef97ca57f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:54.322549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 568/1133] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:54.328014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c084e4-8028-4a7d-959c-2af2c6c2780f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:54.328403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c084e4-8028-4a7d-959c-2af2c6c2780f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:54.328621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c084e4-8028-4a7d-959c-2af2c6c2780f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:54.346050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-75c084e4-8028-4a7d-959c-2af2c6c2780f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:54.347226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-75c084e4-8028-4a7d-959c-2af2c6c2780f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:54.403306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 566/1134] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:54.428367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb30c4-707c-4c5c-ae2c-6d8ef97ca57f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:54.440121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb30c4-707c-4c5c-ae2c-6d8ef97ca57f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:54.444944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c285170-c910-4afb-9e25-b05950761664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:54.445693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285170-c910-4afb-9e25-b05950761664 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:54.445964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285170-c910-4afb-9e25-b05950761664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:54.446227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c285170-c910-4afb-9e25-b05950761664 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:54.447377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c285170-c910-4afb-9e25-b05950761664 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:54.449076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c285170-c910-4afb-9e25-b05950761664 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:54.450854 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 569/1135] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:29:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:54.455893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c084e4-8028-4a7d-959c-2af2c6c2780f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:54.465218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c084e4-8028-4a7d-959c-2af2c6c2780f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:54.469706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a8e1b-24a7-473b-abbe-a721af03a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:54.470344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a8e1b-24a7-473b-abbe-a721af03a035 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:54.470626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a8e1b-24a7-473b-abbe-a721af03a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:54.470901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a8e1b-24a7-473b-abbe-a721af03a035 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:54.471622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a8e1b-24a7-473b-abbe-a721af03a035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:54.473572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a8e1b-24a7-473b-abbe-a721af03a035 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:54.491995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 567/1136] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:29:54 2022] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:29:56.729457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75478-d2a2-4f77-96b9-f56568523cf3 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:56.729899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75478-d2a2-4f77-96b9-f56568523cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:56.729989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75478-d2a2-4f77-96b9-f56568523cf3 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:56.731784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 570/1137] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:56.737110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35296c6-57a3-4aab-a46c-4bcc251bdfe6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:56.737525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35296c6-57a3-4aab-a46c-4bcc251bdfe6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:56.737665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35296c6-57a3-4aab-a46c-4bcc251bdfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:56.755399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a35296c6-57a3-4aab-a46c-4bcc251bdfe6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:56.756601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a35296c6-57a3-4aab-a46c-4bcc251bdfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:56.764111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 568/1138] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:56.788243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f75478-d2a2-4f77-96b9-f56568523cf3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:56.799941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f75478-d2a2-4f77-96b9-f56568523cf3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:56.804259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0ef3f-c7c5-47dd-b766-982ba495f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:56.805036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0ef3f-c7c5-47dd-b766-982ba495f37d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:56.805309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0ef3f-c7c5-47dd-b766-982ba495f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:56.805576 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0ef3f-c7c5-47dd-b766-982ba495f37d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:56.815306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0ef3f-c7c5-47dd-b766-982ba495f37d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:56.822513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-75f0ef3f-c7c5-47dd-b766-982ba495f37d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:56.824259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 571/1139] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:56.829483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35296c6-57a3-4aab-a46c-4bcc251bdfe6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:56.838797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35296c6-57a3-4aab-a46c-4bcc251bdfe6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:56.843280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00583bc-0a37-41e9-9b15-3ff8d3cb9a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:56.843919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00583bc-0a37-41e9-9b15-3ff8d3cb9a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:56.844197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00583bc-0a37-41e9-9b15-3ff8d3cb9a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:56.844506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00583bc-0a37-41e9-9b15-3ff8d3cb9a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:56.845260 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00583bc-0a37-41e9-9b15-3ff8d3cb9a50 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:56.845560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00583bc-0a37-41e9-9b15-3ff8d3cb9a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:56.847128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00583bc-0a37-41e9-9b15-3ff8d3cb9a50 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:56.857575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 569/1140] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:56.867059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0ef3f-c7c5-47dd-b766-982ba495f37d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:56.877135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0ef3f-c7c5-47dd-b766-982ba495f37d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:56.882372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d010c52-e177-4a73-b065-45e7b9e52039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:56.883479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d010c52-e177-4a73-b065-45e7b9e52039 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:56.883752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d010c52-e177-4a73-b065-45e7b9e52039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:56.884018 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d010c52-e177-4a73-b065-45e7b9e52039 admin admin] PATH_INFO: `/v3/users/5789f0625b264b888bcf24f26a05a52b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:56.897968 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d010c52-e177-4a73-b065-45e7b9e52039 admin admin] RBAC: Authorizing `identity:get_user(user_id=5789f0625b264b888bcf24f26a05a52b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:56.900058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d010c52-e177-4a73-b065-45e7b9e52039 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:56.901663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 572/1141] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:56 2022] GET /identity/v3/users/5789f0625b264b888bcf24f26a05a52b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:56.907018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00583bc-0a37-41e9-9b15-3ff8d3cb9a50 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:56.916469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00583bc-0a37-41e9-9b15-3ff8d3cb9a50 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:56.920900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffe03a-3d00-4fb2-b16e-4e5237030553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:56.921520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffe03a-3d00-4fb2-b16e-4e5237030553 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:56.921798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffe03a-3d00-4fb2-b16e-4e5237030553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:56.922067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffe03a-3d00-4fb2-b16e-4e5237030553 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:56.930171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffe03a-3d00-4fb2-b16e-4e5237030553 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:56.931831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffe03a-3d00-4fb2-b16e-4e5237030553 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:56.940491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 570/1142] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:29:56 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:29:56.946450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d010c52-e177-4a73-b065-45e7b9e52039 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:56.955766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d010c52-e177-4a73-b065-45e7b9e52039 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:56.960245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c8c60-ede5-4931-858f-bcc11918ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:56.961074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c8c60-ede5-4931-858f-bcc11918ee9d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:56.961346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c8c60-ede5-4931-858f-bcc11918ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:56.961611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c8c60-ede5-4931-858f-bcc11918ee9d admin admin] PATH_INFO: `/v3/projects/732aac7077ac4686a1cea5b5b202efd1` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:56.962753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c8c60-ede5-4931-858f-bcc11918ee9d admin admin] RBAC: Authorizing `identity:get_project(project_id=732aac7077ac4686a1cea5b5b202efd1)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:56.964739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c8c60-ede5-4931-858f-bcc11918ee9d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:56.966305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 573/1143] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:29:56 2022] GET /identity/v3/projects/732aac7077ac4686a1cea5b5b202efd1 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:56.971621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffe03a-3d00-4fb2-b16e-4e5237030553 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:56.980106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffe03a-3d00-4fb2-b16e-4e5237030553 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:56.984642 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baa9ef-6101-4786-a0b0-e5932bdedb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:56.985252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baa9ef-6101-4786-a0b0-e5932bdedb0c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:56.985529 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baa9ef-6101-4786-a0b0-e5932bdedb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:56.985798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baa9ef-6101-4786-a0b0-e5932bdedb0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:56.986617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baa9ef-6101-4786-a0b0-e5932bdedb0c admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=732aac7077ac4686a1cea5b5b202efd1, user.id=5789f0625b264b888bcf24f26a05a52b) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:56.986927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baa9ef-6101-4786-a0b0-e5932bdedb0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:56.989274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baa9ef-6101-4786-a0b0-e5932bdedb0c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:56.994511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 571/1144] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:29:56 2022] GET /identity/v3/role_assignments?user.id=5789f0625b264b888bcf24f26a05a52b&scope.project.id=732aac7077ac4686a1cea5b5b202efd1&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:59.156174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6516df9-0105-4c4d-b894-a4f0cd2f22ae None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:59.156699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6516df9-0105-4c4d-b894-a4f0cd2f22ae None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:59.156806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6516df9-0105-4c4d-b894-a4f0cd2f22ae None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:59.158501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 574/1145] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:29:59.164130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2ad28-198e-481d-bbf5-0b2810afb4da None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:59.164570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2ad28-198e-481d-bbf5-0b2810afb4da None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:59.164722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2ad28-198e-481d-bbf5-0b2810afb4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:59.182685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7bc2ad28-198e-481d-bbf5-0b2810afb4da None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:29:59.183851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7bc2ad28-198e-481d-bbf5-0b2810afb4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:29:59.191373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 572/1146] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:29:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:29:59.214783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6516df9-0105-4c4d-b894-a4f0cd2f22ae None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:59.227101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6516df9-0105-4c4d-b894-a4f0cd2f22ae None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:59.231347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe2da-6680-4a75-ab79-72654bfcf13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:59.232096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe2da-6680-4a75-ab79-72654bfcf13a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:59.232392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe2da-6680-4a75-ab79-72654bfcf13a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:59.232666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fe2da-6680-4a75-ab79-72654bfcf13a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:59.242479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fe2da-6680-4a75-ab79-72654bfcf13a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:29:59.249151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-e56fe2da-6680-4a75-ab79-72654bfcf13a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:29:59.250249 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 575/1147] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:29:59.255601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2ad28-198e-481d-bbf5-0b2810afb4da None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:59.264245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2ad28-198e-481d-bbf5-0b2810afb4da None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:59.268726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad601d-2e61-46a8-ab69-bb2ffeec8ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:59.269356 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad601d-2e61-46a8-ab69-bb2ffeec8ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:59.270140 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad601d-2e61-46a8-ab69-bb2ffeec8ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:59.270413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad601d-2e61-46a8-ab69-bb2ffeec8ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:59.271159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad601d-2e61-46a8-ab69-bb2ffeec8ae6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:29:59.271459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad601d-2e61-46a8-ab69-bb2ffeec8ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:59.273066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad601d-2e61-46a8-ab69-bb2ffeec8ae6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:59.281038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 573/1148] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:59.286871 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe2da-6680-4a75-ab79-72654bfcf13a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:59.296527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fe2da-6680-4a75-ab79-72654bfcf13a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:59.300922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425805ba-ed10-46fd-88d5-2861c01ad7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:59.301713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425805ba-ed10-46fd-88d5-2861c01ad7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:59.301984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425805ba-ed10-46fd-88d5-2861c01ad7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:59.302250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425805ba-ed10-46fd-88d5-2861c01ad7e5 admin admin] PATH_INFO: `/v3/users/5789f0625b264b888bcf24f26a05a52b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:59.303422 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425805ba-ed10-46fd-88d5-2861c01ad7e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=5789f0625b264b888bcf24f26a05a52b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:59.305523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425805ba-ed10-46fd-88d5-2861c01ad7e5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:59.307066 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 576/1149] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:29:59 2022] GET /identity/v3/users/5789f0625b264b888bcf24f26a05a52b => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:59.312134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad601d-2e61-46a8-ab69-bb2ffeec8ae6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:59.321402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad601d-2e61-46a8-ab69-bb2ffeec8ae6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:59.326092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d15f4c-9ea1-4e36-90a7-d24cfe9c2ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:59.326900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d15f4c-9ea1-4e36-90a7-d24cfe9c2ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:59.327175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d15f4c-9ea1-4e36-90a7-d24cfe9c2ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:59.327445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d15f4c-9ea1-4e36-90a7-d24cfe9c2ac7 admin admin] PATH_INFO: `/v3/projects/732aac7077ac4686a1cea5b5b202efd1` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:59.328675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d15f4c-9ea1-4e36-90a7-d24cfe9c2ac7 admin admin] RBAC: Authorizing `identity:get_project(project_id=732aac7077ac4686a1cea5b5b202efd1)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:59.330672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d15f4c-9ea1-4e36-90a7-d24cfe9c2ac7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:59.332837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 574/1150] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:29:59 2022] GET /identity/v3/projects/732aac7077ac4686a1cea5b5b202efd1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:29:59.338202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425805ba-ed10-46fd-88d5-2861c01ad7e5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:29:59.347418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425805ba-ed10-46fd-88d5-2861c01ad7e5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:29:59.352628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f5af-8014-4af1-9034-9f90752850ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:29:59.353476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f5af-8014-4af1-9034-9f90752850ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:29:59.353751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f5af-8014-4af1-9034-9f90752850ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:29:59.354022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f5af-8014-4af1-9034-9f90752850ca admin admin] PATH_INFO: `/v3/projects/732aac7077ac4686a1cea5b5b202efd1/users/5789f0625b264b888bcf24f26a05a52b/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:29:59.355972 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f5af-8014-4af1-9034-9f90752850ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=732aac7077ac4686a1cea5b5b202efd1, user_id=5789f0625b264b888bcf24f26a05a52b, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:29:59.358588 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f5af-8014-4af1-9034-9f90752850ca admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:29:59.370542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 577/1151] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:29:59 2022] PUT /identity/v3/projects/732aac7077ac4686a1cea5b5b202efd1/users/5789f0625b264b888bcf24f26a05a52b/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:30:01.517575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dfdbe-6ee9-42c3-9f32-dba48a144ff0 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:01.518126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dfdbe-6ee9-42c3-9f32-dba48a144ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:01.518126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dfdbe-6ee9-42c3-9f32-dba48a144ff0 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:01.520424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 575/1152] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:30:01.525476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b1c80-6970-4db3-b15d-edf07e722f61 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:01.525873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b1c80-6970-4db3-b15d-edf07e722f61 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:01.526013 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b1c80-6970-4db3-b15d-edf07e722f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:01.543639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-137b1c80-6970-4db3-b15d-edf07e722f61 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:30:01.544831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-137b1c80-6970-4db3-b15d-edf07e722f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:30:01.600311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 578/1153] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:30:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:30:01.624186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dfdbe-6ee9-42c3-9f32-dba48a144ff0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:01.636681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dfdbe-6ee9-42c3-9f32-dba48a144ff0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:01.641032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499644b4-a4e2-4be9-8361-3d4f2ee0df32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:01.641804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499644b4-a4e2-4be9-8361-3d4f2ee0df32 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:01.642082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499644b4-a4e2-4be9-8361-3d4f2ee0df32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:01.642351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499644b4-a4e2-4be9-8361-3d4f2ee0df32 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:01.652224 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499644b4-a4e2-4be9-8361-3d4f2ee0df32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:30:01.658958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-499644b4-a4e2-4be9-8361-3d4f2ee0df32 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:30:01.660093 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 576/1154] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:30:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:30:01.665791 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b1c80-6970-4db3-b15d-edf07e722f61 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:01.674423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b1c80-6970-4db3-b15d-edf07e722f61 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:01.679391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629d85d-013d-4cf0-8891-dff7558fbf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:01.680030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629d85d-013d-4cf0-8891-dff7558fbf8a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:01.680305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629d85d-013d-4cf0-8891-dff7558fbf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:01.680608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629d85d-013d-4cf0-8891-dff7558fbf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:01.681349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629d85d-013d-4cf0-8891-dff7558fbf8a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:30:01.681644 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629d85d-013d-4cf0-8891-dff7558fbf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:01.683217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629d85d-013d-4cf0-8891-dff7558fbf8a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:01.691180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 579/1155] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:30:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:01.697205 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499644b4-a4e2-4be9-8361-3d4f2ee0df32 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:01.707438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499644b4-a4e2-4be9-8361-3d4f2ee0df32 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:01.711907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c32c5-65df-4a04-84ef-1e065280aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:01.712759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c32c5-65df-4a04-84ef-1e065280aae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:01.713040 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c32c5-65df-4a04-84ef-1e065280aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:01.713312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c32c5-65df-4a04-84ef-1e065280aae6 admin admin] PATH_INFO: `/v3/users/5789f0625b264b888bcf24f26a05a52b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:01.714507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c32c5-65df-4a04-84ef-1e065280aae6 admin admin] RBAC: Authorizing `identity:get_user(user_id=5789f0625b264b888bcf24f26a05a52b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:01.716618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c32c5-65df-4a04-84ef-1e065280aae6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:01.718297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 577/1156] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:30:01 2022] GET /identity/v3/users/5789f0625b264b888bcf24f26a05a52b => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:01.723311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629d85d-013d-4cf0-8891-dff7558fbf8a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:01.732430 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629d85d-013d-4cf0-8891-dff7558fbf8a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:01.736818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9ce3c-1be5-466e-982b-a1affc47c523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:01.737413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ce3c-1be5-466e-982b-a1affc47c523 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:01.737690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ce3c-1be5-466e-982b-a1affc47c523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:01.737957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9ce3c-1be5-466e-982b-a1affc47c523 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:01.745964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9ce3c-1be5-466e-982b-a1affc47c523 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:01.747653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9ce3c-1be5-466e-982b-a1affc47c523 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:01.756748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 580/1157] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:30:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:30:01.761861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c32c5-65df-4a04-84ef-1e065280aae6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:01.771061 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c32c5-65df-4a04-84ef-1e065280aae6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:01.775418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63820dd-b902-4f9a-8714-a034c65234b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:01.776200 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63820dd-b902-4f9a-8714-a034c65234b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:01.776520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63820dd-b902-4f9a-8714-a034c65234b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:01.776795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63820dd-b902-4f9a-8714-a034c65234b2 admin admin] PATH_INFO: `/v3/projects/732aac7077ac4686a1cea5b5b202efd1` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:01.777944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63820dd-b902-4f9a-8714-a034c65234b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=732aac7077ac4686a1cea5b5b202efd1)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:01.779893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63820dd-b902-4f9a-8714-a034c65234b2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:01.781532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 578/1158] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:30:01 2022] GET /identity/v3/projects/732aac7077ac4686a1cea5b5b202efd1 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:01.786868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9ce3c-1be5-466e-982b-a1affc47c523 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:01.795009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9ce3c-1be5-466e-982b-a1affc47c523 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:01.799358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2270173-0c69-42c0-a44a-99a6e4a3bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:01.799940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2270173-0c69-42c0-a44a-99a6e4a3bc03 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:01.800211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2270173-0c69-42c0-a44a-99a6e4a3bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:01.800519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2270173-0c69-42c0-a44a-99a6e4a3bc03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:01.801870 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2270173-0c69-42c0-a44a-99a6e4a3bc03 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=732aac7077ac4686a1cea5b5b202efd1, user.id=5789f0625b264b888bcf24f26a05a52b) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:30:01.802172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2270173-0c69-42c0-a44a-99a6e4a3bc03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:01.803915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2270173-0c69-42c0-a44a-99a6e4a3bc03 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:01.809532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 581/1159] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:30:01 2022] GET /identity/v3/role_assignments?user.id=5789f0625b264b888bcf24f26a05a52b&scope.project.id=732aac7077ac4686a1cea5b5b202efd1&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:04.018697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa530efe-48f0-4746-88e7-66bedc44a887 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:04.019234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa530efe-48f0-4746-88e7-66bedc44a887 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:04.019234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa530efe-48f0-4746-88e7-66bedc44a887 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:04.021499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 579/1160] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:30:04.026965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c02c9-814b-46a1-959b-c4e88fde4db5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:04.027357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c02c9-814b-46a1-959b-c4e88fde4db5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:04.027616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c02c9-814b-46a1-959b-c4e88fde4db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:04.045622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-355c02c9-814b-46a1-959b-c4e88fde4db5 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:30:04.046803 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-355c02c9-814b-46a1-959b-c4e88fde4db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:30:04.054483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 582/1161] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:30:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:30:04.079171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa530efe-48f0-4746-88e7-66bedc44a887 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:04.091722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa530efe-48f0-4746-88e7-66bedc44a887 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:04.095983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766eef5-d20a-41fc-b16c-7bc46488998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:04.096628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766eef5-d20a-41fc-b16c-7bc46488998f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:04.096904 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766eef5-d20a-41fc-b16c-7bc46488998f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:04.097171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766eef5-d20a-41fc-b16c-7bc46488998f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:04.104660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766eef5-d20a-41fc-b16c-7bc46488998f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:04.106371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766eef5-d20a-41fc-b16c-7bc46488998f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:04.114910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 580/1162] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:30:04 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:30:04.120407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c02c9-814b-46a1-959b-c4e88fde4db5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:04.129646 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c02c9-814b-46a1-959b-c4e88fde4db5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:04.134125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8006a-a06b-4d2a-9e29-040e6fe16e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:04.134894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8006a-a06b-4d2a-9e29-040e6fe16e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:04.135174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8006a-a06b-4d2a-9e29-040e6fe16e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:04.135445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8006a-a06b-4d2a-9e29-040e6fe16e02 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:04.142098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8006a-a06b-4d2a-9e29-040e6fe16e02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:04.143908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8006a-a06b-4d2a-9e29-040e6fe16e02 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:04.158492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-cec8006a-a06b-4d2a-9e29-040e6fe16e02 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 07 02:30:04.159590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 583/1163] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:30:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:30:04.165136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766eef5-d20a-41fc-b16c-7bc46488998f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:04.173566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766eef5-d20a-41fc-b16c-7bc46488998f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:04.178055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f1ef3-645f-49e0-be0c-9997751e11c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:04.178671 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f1ef3-645f-49e0-be0c-9997751e11c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:04.178946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f1ef3-645f-49e0-be0c-9997751e11c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:04.179214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f1ef3-645f-49e0-be0c-9997751e11c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:04.179918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f1ef3-645f-49e0-be0c-9997751e11c8 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:30:04.180217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f1ef3-645f-49e0-be0c-9997751e11c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:04.181772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f1ef3-645f-49e0-be0c-9997751e11c8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:04.188744 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 581/1164] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Feb 7 02:30:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:06.339616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364680dd-6b12-4fd1-8674-e2249400aea4 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:06.340168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364680dd-6b12-4fd1-8674-e2249400aea4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:06.340168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364680dd-6b12-4fd1-8674-e2249400aea4 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:06.341936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 584/1165] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:30:06.347137 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16af9f7-eaef-4f44-9f93-3446c73abff0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:06.347590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16af9f7-eaef-4f44-9f93-3446c73abff0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:06.347696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16af9f7-eaef-4f44-9f93-3446c73abff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:06.365120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e16af9f7-eaef-4f44-9f93-3446c73abff0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:30:06.366282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e16af9f7-eaef-4f44-9f93-3446c73abff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:30:06.373744 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 582/1166] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:30:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:30:06.397342 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364680dd-6b12-4fd1-8674-e2249400aea4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:06.409144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364680dd-6b12-4fd1-8674-e2249400aea4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:06.413413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe93e4-26bc-47a4-9a59-e7d1b6658b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:06.414034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe93e4-26bc-47a4-9a59-e7d1b6658b0d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:06.414307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe93e4-26bc-47a4-9a59-e7d1b6658b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:06.414574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe93e4-26bc-47a4-9a59-e7d1b6658b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:06.415311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe93e4-26bc-47a4-9a59-e7d1b6658b0d admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:06.416314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-cabe93e4-26bc-47a4-9a59-e7d1b6658b0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:30:06.416314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:30:06.416314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:30:06.417198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe93e4-26bc-47a4-9a59-e7d1b6658b0d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:06.431341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 585/1167] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Feb 7 02:30:06 2022] POST /identity/v3/domains => generated 267 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:30:08.657741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540bba4-4fdc-4635-98e8-bcbce7428ee6 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:08.658313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540bba4-4fdc-4635-98e8-bcbce7428ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:08.658313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540bba4-4fdc-4635-98e8-bcbce7428ee6 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:08.660068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 583/1168] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:30:08.665291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142c97-542b-40c6-8546-dad513c87f3e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:08.665723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142c97-542b-40c6-8546-dad513c87f3e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:08.665822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b142c97-542b-40c6-8546-dad513c87f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:08.683431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6b142c97-542b-40c6-8546-dad513c87f3e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:30:08.684649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6b142c97-542b-40c6-8546-dad513c87f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:30:08.739317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 586/1169] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:30:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:30:08.763132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540bba4-4fdc-4635-98e8-bcbce7428ee6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:08.775573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540bba4-4fdc-4635-98e8-bcbce7428ee6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:08.779897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905640a-6d12-4283-9f78-f7681a0d1d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:08.780762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905640a-6d12-4283-9f78-f7681a0d1d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:08.781045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905640a-6d12-4283-9f78-f7681a0d1d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:08.781321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905640a-6d12-4283-9f78-f7681a0d1d13 admin admin] PATH_INFO: `/v3/domains/7f9e66b31e2a4f24aa61f4ecfb841ea7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:08.791652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905640a-6d12-4283-9f78-f7681a0d1d13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=7f9e66b31e2a4f24aa61f4ecfb841ea7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:08.793617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905640a-6d12-4283-9f78-f7681a0d1d13 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:08.795187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 584/1170] 10.222.0.15 () {56 vars in 1204 bytes} [Mon Feb 7 02:30:08 2022] GET /identity/v3/domains/7f9e66b31e2a4f24aa61f4ecfb841ea7 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:08.800714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142c97-542b-40c6-8546-dad513c87f3e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:08.809304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b142c97-542b-40c6-8546-dad513c87f3e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:08.813739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6e8f3-30ce-4838-aa44-d6aa43cee24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:08.814378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6e8f3-30ce-4838-aa44-d6aa43cee24a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:08.814687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6e8f3-30ce-4838-aa44-d6aa43cee24a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:08.814987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6e8f3-30ce-4838-aa44-d6aa43cee24a admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:08.815704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6e8f3-30ce-4838-aa44-d6aa43cee24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:08.818176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6e8f3-30ce-4838-aa44-d6aa43cee24a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:08.842725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 587/1171] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:30:08 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:30:11.071829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449637-6809-4919-97cc-1b0f65226721 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:11.072361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449637-6809-4919-97cc-1b0f65226721 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:11.072361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449637-6809-4919-97cc-1b0f65226721 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:11.074104 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 585/1172] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:30:11.079821 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b060a8-2dcb-4afe-aeb8-03cb97ca0091 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:11.080182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b060a8-2dcb-4afe-aeb8-03cb97ca0091 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:11.080407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b060a8-2dcb-4afe-aeb8-03cb97ca0091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:11.098336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-97b060a8-2dcb-4afe-aeb8-03cb97ca0091 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:30:11.099523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-97b060a8-2dcb-4afe-aeb8-03cb97ca0091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:30:11.155957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 588/1173] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:30:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:30:11.182480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449637-6809-4919-97cc-1b0f65226721 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:11.194415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449637-6809-4919-97cc-1b0f65226721 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:11.198760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86065f22-8098-47e1-a065-42c9d0644a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:11.199587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065f22-8098-47e1-a065-42c9d0644a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:11.199865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065f22-8098-47e1-a065-42c9d0644a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:11.200137 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86065f22-8098-47e1-a065-42c9d0644a4e admin admin] PATH_INFO: `/v3/domains/7f9e66b31e2a4f24aa61f4ecfb841ea7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:11.201614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86065f22-8098-47e1-a065-42c9d0644a4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=7f9e66b31e2a4f24aa61f4ecfb841ea7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:11.203531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86065f22-8098-47e1-a065-42c9d0644a4e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:11.205118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 586/1174] 10.222.0.15 () {56 vars in 1204 bytes} [Mon Feb 7 02:30:11 2022] GET /identity/v3/domains/7f9e66b31e2a4f24aa61f4ecfb841ea7 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:11.210940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b060a8-2dcb-4afe-aeb8-03cb97ca0091 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:11.219563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b060a8-2dcb-4afe-aeb8-03cb97ca0091 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:11.224758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ba3ec-51ae-4eac-abba-abb5d277303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:11.225416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ba3ec-51ae-4eac-abba-abb5d277303d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:11.225734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ba3ec-51ae-4eac-abba-abb5d277303d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:11.226043 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ba3ec-51ae-4eac-abba-abb5d277303d admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:11.226774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ba3ec-51ae-4eac-abba-abb5d277303d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:11.228750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ba3ec-51ae-4eac-abba-abb5d277303d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:11.247757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 589/1175] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:30:11 2022] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:30:13.455722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2d08-b961-4429-9a25-a5981159e2d4 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:13.456232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2d08-b961-4429-9a25-a5981159e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:13.456318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2d08-b961-4429-9a25-a5981159e2d4 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:13.458127 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 587/1176] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:30:13.463187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28a70-c401-45cf-ba37-97a923896a3b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:13.463559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28a70-c401-45cf-ba37-97a923896a3b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:13.463728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce28a70-c401-45cf-ba37-97a923896a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:13.481750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6ce28a70-c401-45cf-ba37-97a923896a3b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:30:13.482924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6ce28a70-c401-45cf-ba37-97a923896a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:30:13.491041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 590/1177] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:30:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:30:13.515133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2d08-b961-4429-9a25-a5981159e2d4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:13.526974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2d08-b961-4429-9a25-a5981159e2d4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:13.531265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe7a01-8778-4b7b-9da3-65d90ea57dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:13.532024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe7a01-8778-4b7b-9da3-65d90ea57dff admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:13.532302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe7a01-8778-4b7b-9da3-65d90ea57dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:13.532605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe7a01-8778-4b7b-9da3-65d90ea57dff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:13.543091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe7a01-8778-4b7b-9da3-65d90ea57dff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:30:13.550026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e7fe7a01-8778-4b7b-9da3-65d90ea57dff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:30:13.551703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 588/1178] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:30:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:30:13.557509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce28a70-c401-45cf-ba37-97a923896a3b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:13.566822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce28a70-c401-45cf-ba37-97a923896a3b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:13.571226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445441d-48ab-4785-9f42-c99f65fa9549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:13.571876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445441d-48ab-4785-9f42-c99f65fa9549 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:13.572183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445441d-48ab-4785-9f42-c99f65fa9549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:13.572514 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445441d-48ab-4785-9f42-c99f65fa9549 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:13.573284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445441d-48ab-4785-9f42-c99f65fa9549 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:30:13.573604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445441d-48ab-4785-9f42-c99f65fa9549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:13.575208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445441d-48ab-4785-9f42-c99f65fa9549 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:13.583624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 591/1179] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:30:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:13.588875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe7a01-8778-4b7b-9da3-65d90ea57dff admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:13.598187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe7a01-8778-4b7b-9da3-65d90ea57dff admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:13.602582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69457525-c5da-4b59-94d3-d6bc188cb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:13.603406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69457525-c5da-4b59-94d3-d6bc188cb9bd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:13.603680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69457525-c5da-4b59-94d3-d6bc188cb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:13.603948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69457525-c5da-4b59-94d3-d6bc188cb9bd admin admin] PATH_INFO: `/v3/users/4ffc9b1ae5554a399bb84021a49f3a1d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:13.618580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69457525-c5da-4b59-94d3-d6bc188cb9bd admin admin] RBAC: Authorizing `identity:get_user(user_id=4ffc9b1ae5554a399bb84021a49f3a1d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:13.620773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69457525-c5da-4b59-94d3-d6bc188cb9bd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:13.622407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 589/1180] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:30:13 2022] GET /identity/v3/users/4ffc9b1ae5554a399bb84021a49f3a1d => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:13.627836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445441d-48ab-4785-9f42-c99f65fa9549 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:13.637964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445441d-48ab-4785-9f42-c99f65fa9549 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:13.642376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50662357-3fb3-452a-8d5f-5da09065f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:13.643010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50662357-3fb3-452a-8d5f-5da09065f87b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:13.643320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50662357-3fb3-452a-8d5f-5da09065f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:13.643625 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50662357-3fb3-452a-8d5f-5da09065f87b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:13.651163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50662357-3fb3-452a-8d5f-5da09065f87b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:13.652918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50662357-3fb3-452a-8d5f-5da09065f87b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:13.661517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 592/1181] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:30:13 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:30:13.666803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69457525-c5da-4b59-94d3-d6bc188cb9bd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:13.677312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69457525-c5da-4b59-94d3-d6bc188cb9bd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:13.681382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8c74b-273b-4400-b182-2ae9fd654132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:13.682208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8c74b-273b-4400-b182-2ae9fd654132 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:13.682487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8c74b-273b-4400-b182-2ae9fd654132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:13.682760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8c74b-273b-4400-b182-2ae9fd654132 admin admin] PATH_INFO: `/v3/projects/d85e1609a61d4b79a6d33525099da762` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:13.683931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8c74b-273b-4400-b182-2ae9fd654132 admin admin] RBAC: Authorizing `identity:get_project(project_id=d85e1609a61d4b79a6d33525099da762)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:13.685988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8c74b-273b-4400-b182-2ae9fd654132 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:13.687657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 590/1182] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:30:13 2022] GET /identity/v3/projects/d85e1609a61d4b79a6d33525099da762 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:13.693966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50662357-3fb3-452a-8d5f-5da09065f87b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:13.702921 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50662357-3fb3-452a-8d5f-5da09065f87b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:13.707459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452e1d3-4d82-4628-9a60-0b3391ec0443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:13.708047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e1d3-4d82-4628-9a60-0b3391ec0443 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:13.708371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e1d3-4d82-4628-9a60-0b3391ec0443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:13.708704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e1d3-4d82-4628-9a60-0b3391ec0443 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:13.709532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452e1d3-4d82-4628-9a60-0b3391ec0443 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=d85e1609a61d4b79a6d33525099da762, user.id=4ffc9b1ae5554a399bb84021a49f3a1d) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:30:13.709847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452e1d3-4d82-4628-9a60-0b3391ec0443 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:13.711723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452e1d3-4d82-4628-9a60-0b3391ec0443 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:13.716893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 593/1183] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:30:13 2022] GET /identity/v3/role_assignments?user.id=4ffc9b1ae5554a399bb84021a49f3a1d&scope.project.id=d85e1609a61d4b79a6d33525099da762&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:15.879329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce254b-3db6-44b4-926c-741d38c50a53 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:15.879838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce254b-3db6-44b4-926c-741d38c50a53 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:15.879838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce254b-3db6-44b4-926c-741d38c50a53 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:15.881690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 591/1184] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:30:15.886861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2ed90-d0c9-4b45-88ca-4bb1c6bc0a00 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:15.887272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2ed90-d0c9-4b45-88ca-4bb1c6bc0a00 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:15.887471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2ed90-d0c9-4b45-88ca-4bb1c6bc0a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:16.019412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2af2ed90-d0c9-4b45-88ca-4bb1c6bc0a00 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:30:16.020548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2af2ed90-d0c9-4b45-88ca-4bb1c6bc0a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:30:16.028095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 594/1185] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:30:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:30:16.051373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce254b-3db6-44b4-926c-741d38c50a53 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:16.063335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce254b-3db6-44b4-926c-741d38c50a53 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:16.068236 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c765e-fc70-451f-80a5-6e0e36f2ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:16.069034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c765e-fc70-451f-80a5-6e0e36f2ef44 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:16.069312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c765e-fc70-451f-80a5-6e0e36f2ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:16.069581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c765e-fc70-451f-80a5-6e0e36f2ef44 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:16.079934 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c765e-fc70-451f-80a5-6e0e36f2ef44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:30:16.086631 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-622c765e-fc70-451f-80a5-6e0e36f2ef44 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:30:16.087762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 592/1186] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:30:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:30:16.093294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2ed90-d0c9-4b45-88ca-4bb1c6bc0a00 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:16.102322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2ed90-d0c9-4b45-88ca-4bb1c6bc0a00 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:16.106655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457480fb-da51-40c2-90cd-6134e608bfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:16.107288 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457480fb-da51-40c2-90cd-6134e608bfe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:16.107560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457480fb-da51-40c2-90cd-6134e608bfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:16.107826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457480fb-da51-40c2-90cd-6134e608bfe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:16.108595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457480fb-da51-40c2-90cd-6134e608bfe3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:30:16.108892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457480fb-da51-40c2-90cd-6134e608bfe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:16.110459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457480fb-da51-40c2-90cd-6134e608bfe3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:16.118921 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 595/1187] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:16.124489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c765e-fc70-451f-80a5-6e0e36f2ef44 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:16.133935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c765e-fc70-451f-80a5-6e0e36f2ef44 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:16.138439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148a64-4071-420a-a44a-f49dbf739866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:16.139264 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148a64-4071-420a-a44a-f49dbf739866 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:16.139543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148a64-4071-420a-a44a-f49dbf739866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:16.139814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7148a64-4071-420a-a44a-f49dbf739866 admin admin] PATH_INFO: `/v3/users/4ffc9b1ae5554a399bb84021a49f3a1d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:16.141019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7148a64-4071-420a-a44a-f49dbf739866 admin admin] RBAC: Authorizing `identity:get_user(user_id=4ffc9b1ae5554a399bb84021a49f3a1d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:16.143143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7148a64-4071-420a-a44a-f49dbf739866 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:16.144746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 593/1188] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:30:16 2022] GET /identity/v3/users/4ffc9b1ae5554a399bb84021a49f3a1d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:16.149962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457480fb-da51-40c2-90cd-6134e608bfe3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:16.159278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457480fb-da51-40c2-90cd-6134e608bfe3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:16.164217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f5bf-4b53-44ec-a85a-bfb2c48ae1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:16.165068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f5bf-4b53-44ec-a85a-bfb2c48ae1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:16.165348 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f5bf-4b53-44ec-a85a-bfb2c48ae1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:16.165621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f5bf-4b53-44ec-a85a-bfb2c48ae1f0 admin admin] PATH_INFO: `/v3/projects/d85e1609a61d4b79a6d33525099da762` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:16.166794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f5bf-4b53-44ec-a85a-bfb2c48ae1f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d85e1609a61d4b79a6d33525099da762)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:16.168849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f5bf-4b53-44ec-a85a-bfb2c48ae1f0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:16.170609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 596/1189] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:30:16 2022] GET /identity/v3/projects/d85e1609a61d4b79a6d33525099da762 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:16.176225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148a64-4071-420a-a44a-f49dbf739866 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:16.186089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7148a64-4071-420a-a44a-f49dbf739866 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:16.190632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14b86e-661c-404d-9337-8e00df10267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:16.191521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b86e-661c-404d-9337-8e00df10267f admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:16.191801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b86e-661c-404d-9337-8e00df10267f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:16.192076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14b86e-661c-404d-9337-8e00df10267f admin admin] PATH_INFO: `/v3/projects/d85e1609a61d4b79a6d33525099da762/users/4ffc9b1ae5554a399bb84021a49f3a1d/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:16.194068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14b86e-661c-404d-9337-8e00df10267f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85e1609a61d4b79a6d33525099da762, user_id=4ffc9b1ae5554a399bb84021a49f3a1d, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:16.196658 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14b86e-661c-404d-9337-8e00df10267f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:16.209543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 594/1190] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:30:16 2022] PUT /identity/v3/projects/d85e1609a61d4b79a6d33525099da762/users/4ffc9b1ae5554a399bb84021a49f3a1d/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:30:18.358628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8bd2a-2da4-4591-b80d-59c381b57d2f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:18.359163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8bd2a-2da4-4591-b80d-59c381b57d2f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:18.359163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8bd2a-2da4-4591-b80d-59c381b57d2f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:18.360984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 597/1191] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:30:18.366747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022a0e-800c-4313-98a6-601bc8bc8620 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:18.367142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022a0e-800c-4313-98a6-601bc8bc8620 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:18.367291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022a0e-800c-4313-98a6-601bc8bc8620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:18.384416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e8022a0e-800c-4313-98a6-601bc8bc8620 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:30:18.385583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e8022a0e-800c-4313-98a6-601bc8bc8620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:30:18.440052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 595/1192] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:30:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:30:18.464745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8bd2a-2da4-4591-b80d-59c381b57d2f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:18.477218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8bd2a-2da4-4591-b80d-59c381b57d2f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:18.481630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917808d-d3a7-4828-a740-14b067408133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:18.482393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917808d-d3a7-4828-a740-14b067408133 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:18.482671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917808d-d3a7-4828-a740-14b067408133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:18.482939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917808d-d3a7-4828-a740-14b067408133 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:18.493817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917808d-d3a7-4828-a740-14b067408133 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:30:18.500486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-7917808d-d3a7-4828-a740-14b067408133 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:30:18.501615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 598/1193] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:30:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:30:18.507140 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8022a0e-800c-4313-98a6-601bc8bc8620 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:18.516017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8022a0e-800c-4313-98a6-601bc8bc8620 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:18.520543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef6b30-3315-4fb4-af5d-5b0984c1990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:18.521188 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef6b30-3315-4fb4-af5d-5b0984c1990a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:18.521464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef6b30-3315-4fb4-af5d-5b0984c1990a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:18.521736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef6b30-3315-4fb4-af5d-5b0984c1990a admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:18.522480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef6b30-3315-4fb4-af5d-5b0984c1990a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:30:18.522780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef6b30-3315-4fb4-af5d-5b0984c1990a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:18.524361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef6b30-3315-4fb4-af5d-5b0984c1990a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:18.532313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 596/1194] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:30:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:18.538107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917808d-d3a7-4828-a740-14b067408133 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:18.547407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917808d-d3a7-4828-a740-14b067408133 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:18.552438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4af12-647f-4a2a-863a-ae38565dde45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:18.553257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4af12-647f-4a2a-863a-ae38565dde45 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:18.553534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4af12-647f-4a2a-863a-ae38565dde45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:18.553808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4af12-647f-4a2a-863a-ae38565dde45 admin admin] PATH_INFO: `/v3/users/4ffc9b1ae5554a399bb84021a49f3a1d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:18.554998 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4af12-647f-4a2a-863a-ae38565dde45 admin admin] RBAC: Authorizing `identity:get_user(user_id=4ffc9b1ae5554a399bb84021a49f3a1d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:18.557155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4af12-647f-4a2a-863a-ae38565dde45 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:18.558688 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 599/1195] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Feb 7 02:30:18 2022] GET /identity/v3/users/4ffc9b1ae5554a399bb84021a49f3a1d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:18.564180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef6b30-3315-4fb4-af5d-5b0984c1990a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:18.573587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef6b30-3315-4fb4-af5d-5b0984c1990a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:18.578338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997688c7-89bb-4b45-bec9-1ebdd94eac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:18.578953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997688c7-89bb-4b45-bec9-1ebdd94eac75 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:18.579228 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997688c7-89bb-4b45-bec9-1ebdd94eac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:18.579498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997688c7-89bb-4b45-bec9-1ebdd94eac75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:18.587029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997688c7-89bb-4b45-bec9-1ebdd94eac75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:18.588787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997688c7-89bb-4b45-bec9-1ebdd94eac75 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:18.597859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 597/1196] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:30:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:30:18.603176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4af12-647f-4a2a-863a-ae38565dde45 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:18.612573 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4af12-647f-4a2a-863a-ae38565dde45 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:18.617643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260d0ed-8d9c-4fdb-8963-d26b5ce0b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:18.618470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260d0ed-8d9c-4fdb-8963-d26b5ce0b82c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:18.618748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260d0ed-8d9c-4fdb-8963-d26b5ce0b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:18.619023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260d0ed-8d9c-4fdb-8963-d26b5ce0b82c admin admin] PATH_INFO: `/v3/projects/d85e1609a61d4b79a6d33525099da762` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:18.620196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260d0ed-8d9c-4fdb-8963-d26b5ce0b82c admin admin] RBAC: Authorizing `identity:get_project(project_id=d85e1609a61d4b79a6d33525099da762)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:18.622257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260d0ed-8d9c-4fdb-8963-d26b5ce0b82c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:18.623896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 600/1197] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:30:18 2022] GET /identity/v3/projects/d85e1609a61d4b79a6d33525099da762 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:30:18.629760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997688c7-89bb-4b45-bec9-1ebdd94eac75 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:30:18.638961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997688c7-89bb-4b45-bec9-1ebdd94eac75 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:30:18.643557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d44ca-cfdd-4786-b705-9b4174b3f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:30:18.644222 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d44ca-cfdd-4786-b705-9b4174b3f165 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:30:18.644539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d44ca-cfdd-4786-b705-9b4174b3f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:30:18.644814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d44ca-cfdd-4786-b705-9b4174b3f165 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:30:18.645645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d44ca-cfdd-4786-b705-9b4174b3f165 admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=d85e1609a61d4b79a6d33525099da762, user.id=4ffc9b1ae5554a399bb84021a49f3a1d) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:30:18.645956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d44ca-cfdd-4786-b705-9b4174b3f165 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:30:18.647783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d44ca-cfdd-4786-b705-9b4174b3f165 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:30:18.653458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 598/1198] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:30:18 2022] GET /identity/v3/role_assignments?user.id=4ffc9b1ae5554a399bb84021a49f3a1d&scope.project.id=d85e1609a61d4b79a6d33525099da762&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:18.661368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ee26-f35e-491b-9d85-d0df5143450f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:18.662012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ee26-f35e-491b-9d85-d0df5143450f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:18.662012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ee26-f35e-491b-9d85-d0df5143450f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:18.663678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 601/1199] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:18.669393 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970662-35f1-4de8-9e3a-039523b42444 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:18.669856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970662-35f1-4de8-9e3a-039523b42444 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:18.669961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12970662-35f1-4de8-9e3a-039523b42444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:18.690894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-12970662-35f1-4de8-9e3a-039523b42444 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:18.692099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-12970662-35f1-4de8-9e3a-039523b42444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:18.702603 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 599/1200] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:18.727105 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492ee26-f35e-491b-9d85-d0df5143450f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:18.741852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492ee26-f35e-491b-9d85-d0df5143450f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:18.746769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf182a8-2c1e-43cb-9094-fda1d0667aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:18.747640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf182a8-2c1e-43cb-9094-fda1d0667aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:18.748002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf182a8-2c1e-43cb-9094-fda1d0667aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:18.748326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf182a8-2c1e-43cb-9094-fda1d0667aa7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:18.762952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf182a8-2c1e-43cb-9094-fda1d0667aa7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:18.764813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf182a8-2c1e-43cb-9094-fda1d0667aa7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:18.781815 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-6cf182a8-2c1e-43cb-9094-fda1d0667aa7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:18.788412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 602/1201] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:18.789470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12970662-35f1-4de8-9e3a-039523b42444 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:18.800366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12970662-35f1-4de8-9e3a-039523b42444 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:18.805455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb0a24-0886-4db5-901f-e373a3c58b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:18.806117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb0a24-0886-4db5-901f-e373a3c58b7f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:18.806400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb0a24-0886-4db5-901f-e373a3c58b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:18.806676 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb0a24-0886-4db5-901f-e373a3c58b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:18.807417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb0a24-0886-4db5-901f-e373a3c58b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:18.807722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb0a24-0886-4db5-901f-e373a3c58b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:18.809404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb0a24-0886-4db5-901f-e373a3c58b7f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:18.830947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf182a8-2c1e-43cb-9094-fda1d0667aa7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:18.831817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 600/1202] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:18.840891 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf182a8-2c1e-43cb-9094-fda1d0667aa7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:18.846729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4ba17-7e53-45b5-9dd7-09f82288a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:18.846729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4ba17-7e53-45b5-9dd7-09f82288a157 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:18.846729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4ba17-7e53-45b5-9dd7-09f82288a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:18.847041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4ba17-7e53-45b5-9dd7-09f82288a157 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:18.847726 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4ba17-7e53-45b5-9dd7-09f82288a157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:18.849730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4ba17-7e53-45b5-9dd7-09f82288a157 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:18.873027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 603/1203] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Feb 7 02:31:18 2022] POST /identity/v3/users => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:31:21.385374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c29233-3930-4f33-ab9c-cdfb96700f36 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.385909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c29233-3930-4f33-ab9c-cdfb96700f36 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.385909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c29233-3930-4f33-ab9c-cdfb96700f36 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.387724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 601/1204] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:21.394135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c3285-9944-4f55-b206-afdcc7df663c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.394588 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c3285-9944-4f55-b206-afdcc7df663c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.394674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c3285-9944-4f55-b206-afdcc7df663c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.417424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-047c3285-9944-4f55-b206-afdcc7df663c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:21.419084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-047c3285-9944-4f55-b206-afdcc7df663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:21.427867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 604/1205] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:21.454219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c29233-3930-4f33-ab9c-cdfb96700f36 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.469648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c29233-3930-4f33-ab9c-cdfb96700f36 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.474911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8501d3f-a224-42c1-82a3-b4e549ac68a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.475746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8501d3f-a224-42c1-82a3-b4e549ac68a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.476031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8501d3f-a224-42c1-82a3-b4e549ac68a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.476307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8501d3f-a224-42c1-82a3-b4e549ac68a5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.488972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8501d3f-a224-42c1-82a3-b4e549ac68a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:31:21.496592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c8501d3f-a224-42c1-82a3-b4e549ac68a5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:31:21.497964 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 602/1206] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:21.505248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c3285-9944-4f55-b206-afdcc7df663c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.515496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c3285-9944-4f55-b206-afdcc7df663c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.520723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cb822-5ee1-48c4-b4f2-aca8ce68778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.521484 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cb822-5ee1-48c4-b4f2-aca8ce68778d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.521946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cb822-5ee1-48c4-b4f2-aca8ce68778d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.522123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cb822-5ee1-48c4-b4f2-aca8ce68778d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.522914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cb822-5ee1-48c4-b4f2-aca8ce68778d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:21.523265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cb822-5ee1-48c4-b4f2-aca8ce68778d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.525388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cb822-5ee1-48c4-b4f2-aca8ce68778d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.535649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 605/1207] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:21.541868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8501d3f-a224-42c1-82a3-b4e549ac68a5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.552443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8501d3f-a224-42c1-82a3-b4e549ac68a5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.557853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d431b07-50b7-41aa-af83-a841edf27bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.558706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d431b07-50b7-41aa-af83-a841edf27bee admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.559046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d431b07-50b7-41aa-af83-a841edf27bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.559331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d431b07-50b7-41aa-af83-a841edf27bee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.572086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d431b07-50b7-41aa-af83-a841edf27bee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.574126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d431b07-50b7-41aa-af83-a841edf27bee admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.593625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6d431b07-50b7-41aa-af83-a841edf27bee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:21.595017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 603/1208] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:21.601720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cb822-5ee1-48c4-b4f2-aca8ce68778d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.611621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cb822-5ee1-48c4-b4f2-aca8ce68778d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.616455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cdb6b-1254-4688-b197-66ff1582080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.617214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cdb6b-1254-4688-b197-66ff1582080a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.617564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cdb6b-1254-4688-b197-66ff1582080a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.617919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cdb6b-1254-4688-b197-66ff1582080a admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.618661 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cdb6b-1254-4688-b197-66ff1582080a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:21.618957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cdb6b-1254-4688-b197-66ff1582080a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.620745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cdb6b-1254-4688-b197-66ff1582080a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.635554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 606/1209] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:21.645652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d431b07-50b7-41aa-af83-a841edf27bee admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.658703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d431b07-50b7-41aa-af83-a841edf27bee admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.663419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbf801-7f4a-48e5-a90a-5dcf688d0dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.664208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbf801-7f4a-48e5-a90a-5dcf688d0dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.664520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbf801-7f4a-48e5-a90a-5dcf688d0dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.664797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbf801-7f4a-48e5-a90a-5dcf688d0dc6 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.676430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbf801-7f4a-48e5-a90a-5dcf688d0dc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.681135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbf801-7f4a-48e5-a90a-5dcf688d0dc6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.697741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e8fbf801-7f4a-48e5-a90a-5dcf688d0dc6 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 02:31:21.699233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 604/1210] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:21.706301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cdb6b-1254-4688-b197-66ff1582080a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.716765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cdb6b-1254-4688-b197-66ff1582080a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.724658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9baa32-e2b5-40b0-8ae3-4f3a3f61a42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.725319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9baa32-e2b5-40b0-8ae3-4f3a3f61a42b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.725596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9baa32-e2b5-40b0-8ae3-4f3a3f61a42b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.725884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9baa32-e2b5-40b0-8ae3-4f3a3f61a42b admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.726745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9baa32-e2b5-40b0-8ae3-4f3a3f61a42b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:21.727125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9baa32-e2b5-40b0-8ae3-4f3a3f61a42b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.729036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9baa32-e2b5-40b0-8ae3-4f3a3f61a42b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.755948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 607/1211] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:21.758004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbf801-7f4a-48e5-a90a-5dcf688d0dc6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.769769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbf801-7f4a-48e5-a90a-5dcf688d0dc6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.775597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8a5c2-3689-45dc-bfde-cd8f6340e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.776756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8a5c2-3689-45dc-bfde-cd8f6340e1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.777303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8a5c2-3689-45dc-bfde-cd8f6340e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.777738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8a5c2-3689-45dc-bfde-cd8f6340e1b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.789455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8a5c2-3689-45dc-bfde-cd8f6340e1b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.791403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8a5c2-3689-45dc-bfde-cd8f6340e1b2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.804543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 605/1212] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:31:21.810055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9baa32-e2b5-40b0-8ae3-4f3a3f61a42b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.822410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9baa32-e2b5-40b0-8ae3-4f3a3f61a42b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.828743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645f9d-fedb-4d61-b219-f4e8c108fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.829760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645f9d-fedb-4d61-b219-f4e8c108fc8b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.830150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645f9d-fedb-4d61-b219-f4e8c108fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.830494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19645f9d-fedb-4d61-b219-f4e8c108fc8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.841751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19645f9d-fedb-4d61-b219-f4e8c108fc8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.844071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19645f9d-fedb-4d61-b219-f4e8c108fc8b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.862560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-19645f9d-fedb-4d61-b219-f4e8c108fc8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:21.863929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 608/1213] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:21.871757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8a5c2-3689-45dc-bfde-cd8f6340e1b2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.883410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8a5c2-3689-45dc-bfde-cd8f6340e1b2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.888892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c94b6b-f498-4d01-bc9a-f7c692db210e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.889494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c94b6b-f498-4d01-bc9a-f7c692db210e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.889775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c94b6b-f498-4d01-bc9a-f7c692db210e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.890050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c94b6b-f498-4d01-bc9a-f7c692db210e admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.890812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c94b6b-f498-4d01-bc9a-f7c692db210e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:21.891147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c94b6b-f498-4d01-bc9a-f7c692db210e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.893405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c94b6b-f498-4d01-bc9a-f7c692db210e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.906662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 606/1214] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:21.912367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645f9d-fedb-4d61-b219-f4e8c108fc8b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.922181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19645f9d-fedb-4d61-b219-f4e8c108fc8b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.927376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb940140-f8cf-4e37-80b5-c4200f6adec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.928146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb940140-f8cf-4e37-80b5-c4200f6adec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.928451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb940140-f8cf-4e37-80b5-c4200f6adec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.928722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb940140-f8cf-4e37-80b5-c4200f6adec8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.935617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb940140-f8cf-4e37-80b5-c4200f6adec8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.937626 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb940140-f8cf-4e37-80b5-c4200f6adec8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.951327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-cb940140-f8cf-4e37-80b5-c4200f6adec8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:31:21.957358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 609/1215] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:21.958607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c94b6b-f498-4d01-bc9a-f7c692db210e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:21.968698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c94b6b-f498-4d01-bc9a-f7c692db210e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:21.974555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d157fa-d386-4b05-a5a0-530f7c4e368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:21.974555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d157fa-d386-4b05-a5a0-530f7c4e368b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:21.974555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d157fa-d386-4b05-a5a0-530f7c4e368b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:21.974555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d157fa-d386-4b05-a5a0-530f7c4e368b admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:21.975357 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d157fa-d386-4b05-a5a0-530f7c4e368b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:21.975668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d157fa-d386-4b05-a5a0-530f7c4e368b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:21.977518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d157fa-d386-4b05-a5a0-530f7c4e368b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:21.990650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 607/1216] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:21.996833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb940140-f8cf-4e37-80b5-c4200f6adec8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:22.008505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb940140-f8cf-4e37-80b5-c4200f6adec8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:22.013975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46340a9d-adc7-4fbb-bf5d-3c8d9e48f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:22.014698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340a9d-adc7-4fbb-bf5d-3c8d9e48f75f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:22.015019 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340a9d-adc7-4fbb-bf5d-3c8d9e48f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:22.015327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46340a9d-adc7-4fbb-bf5d-3c8d9e48f75f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:22.016239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340a9d-adc7-4fbb-bf5d-3c8d9e48f75f admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=b06b37b8f23946ebbb5083a877274ea5) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:22.016649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340a9d-adc7-4fbb-bf5d-3c8d9e48f75f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:22.018782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46340a9d-adc7-4fbb-bf5d-3c8d9e48f75f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:22.025227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 610/1217] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:31:21 2022] GET /identity/v3/role_assignments?user.id=b06b37b8f23946ebbb5083a877274ea5&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:24.355609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4305c2-bdfa-4eda-a35a-91071543a1c3 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.356134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4305c2-bdfa-4eda-a35a-91071543a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.356134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4305c2-bdfa-4eda-a35a-91071543a1c3 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.358146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 608/1218] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:24.365003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343514b-d8d8-49cb-a265-618156e3a7a1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.365507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343514b-d8d8-49cb-a265-618156e3a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.365507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343514b-d8d8-49cb-a265-618156e3a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.385830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a343514b-d8d8-49cb-a265-618156e3a7a1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:24.387327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a343514b-d8d8-49cb-a265-618156e3a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:24.399336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 611/1219] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:24.425455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4305c2-bdfa-4eda-a35a-91071543a1c3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.439870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4305c2-bdfa-4eda-a35a-91071543a1c3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.445134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2426-8b44-420c-9115-367922b07004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.445926 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2426-8b44-420c-9115-367922b07004 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.446208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2426-8b44-420c-9115-367922b07004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.446480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2426-8b44-420c-9115-367922b07004 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.459351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d2426-8b44-420c-9115-367922b07004 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:31:24.468708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-579d2426-8b44-420c-9115-367922b07004 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:31:24.470319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 609/1220] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:24.477206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343514b-d8d8-49cb-a265-618156e3a7a1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.487430 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343514b-d8d8-49cb-a265-618156e3a7a1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.493946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863766c-3c26-4c65-aa0e-9837abaf67b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.493946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863766c-3c26-4c65-aa0e-9837abaf67b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.493946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863766c-3c26-4c65-aa0e-9837abaf67b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.494253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863766c-3c26-4c65-aa0e-9837abaf67b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.494961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863766c-3c26-4c65-aa0e-9837abaf67b4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:24.495266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863766c-3c26-4c65-aa0e-9837abaf67b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.497365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863766c-3c26-4c65-aa0e-9837abaf67b4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.511466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 612/1221] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:24.513547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2426-8b44-420c-9115-367922b07004 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.526495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2426-8b44-420c-9115-367922b07004 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.532159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d531c-25bf-45dc-ae4f-bba7719141e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.533434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d531c-25bf-45dc-ae4f-bba7719141e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.533721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d531c-25bf-45dc-ae4f-bba7719141e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.534147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d531c-25bf-45dc-ae4f-bba7719141e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.546662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d531c-25bf-45dc-ae4f-bba7719141e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.549101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d531c-25bf-45dc-ae4f-bba7719141e0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.570583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f58d531c-25bf-45dc-ae4f-bba7719141e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:24.572385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 610/1222] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:24.578268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863766c-3c26-4c65-aa0e-9837abaf67b4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.589228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863766c-3c26-4c65-aa0e-9837abaf67b4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.594231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920e9fc-6ab8-47bc-88b8-30223ce24c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.594881 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e9fc-6ab8-47bc-88b8-30223ce24c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.595167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e9fc-6ab8-47bc-88b8-30223ce24c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.595439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920e9fc-6ab8-47bc-88b8-30223ce24c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.596164 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920e9fc-6ab8-47bc-88b8-30223ce24c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:24.596512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920e9fc-6ab8-47bc-88b8-30223ce24c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.598098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920e9fc-6ab8-47bc-88b8-30223ce24c10 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.614128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 613/1223] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:24.619464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d531c-25bf-45dc-ae4f-bba7719141e0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.629898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d531c-25bf-45dc-ae4f-bba7719141e0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.634914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da330c0c-5b4f-40fc-b524-895cc77f8e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.635758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da330c0c-5b4f-40fc-b524-895cc77f8e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.636045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da330c0c-5b4f-40fc-b524-895cc77f8e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.636319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da330c0c-5b4f-40fc-b524-895cc77f8e24 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.644967 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da330c0c-5b4f-40fc-b524-895cc77f8e24 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.647266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da330c0c-5b4f-40fc-b524-895cc77f8e24 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.661989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-da330c0c-5b4f-40fc-b524-895cc77f8e24 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 02:31:24.663561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 611/1224] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:24.669493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920e9fc-6ab8-47bc-88b8-30223ce24c10 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.682091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920e9fc-6ab8-47bc-88b8-30223ce24c10 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.690620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a0c79-d221-4385-939a-0163137263fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.691559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a0c79-d221-4385-939a-0163137263fa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.691957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a0c79-d221-4385-939a-0163137263fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.692421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a0c79-d221-4385-939a-0163137263fa admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.693391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a0c79-d221-4385-939a-0163137263fa admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:24.693873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a0c79-d221-4385-939a-0163137263fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.695967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a0c79-d221-4385-939a-0163137263fa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.715649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 614/1225] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:24.721523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da330c0c-5b4f-40fc-b524-895cc77f8e24 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.733139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da330c0c-5b4f-40fc-b524-895cc77f8e24 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.739700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cd70d-4398-4086-82dd-758b38502579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.740667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cd70d-4398-4086-82dd-758b38502579 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.741066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cd70d-4398-4086-82dd-758b38502579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.741378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cd70d-4398-4086-82dd-758b38502579 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.754763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cd70d-4398-4086-82dd-758b38502579 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.756629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cd70d-4398-4086-82dd-758b38502579 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.776824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-481cd70d-4398-4086-82dd-758b38502579 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:24.778196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 612/1226] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:31:24.784399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a0c79-d221-4385-939a-0163137263fa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.794862 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a0c79-d221-4385-939a-0163137263fa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.800571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619dd36-d141-416b-b49b-26e4e9023000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.801247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619dd36-d141-416b-b49b-26e4e9023000 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.801528 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619dd36-d141-416b-b49b-26e4e9023000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.801801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619dd36-d141-416b-b49b-26e4e9023000 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.802532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619dd36-d141-416b-b49b-26e4e9023000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:24.802834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619dd36-d141-416b-b49b-26e4e9023000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.804458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619dd36-d141-416b-b49b-26e4e9023000 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.816390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 615/1227] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:24.822596 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cd70d-4398-4086-82dd-758b38502579 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.835285 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cd70d-4398-4086-82dd-758b38502579 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.839881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd6049-6601-408b-a2b1-936ca1ab20ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.840715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd6049-6601-408b-a2b1-936ca1ab20ad admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.840995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd6049-6601-408b-a2b1-936ca1ab20ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.841263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd6049-6601-408b-a2b1-936ca1ab20ad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.849132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd6049-6601-408b-a2b1-936ca1ab20ad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.851087 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd6049-6601-408b-a2b1-936ca1ab20ad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.866011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-cefd6049-6601-408b-a2b1-936ca1ab20ad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:31:24.867535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 613/1228] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:24.874789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619dd36-d141-416b-b49b-26e4e9023000 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.886787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619dd36-d141-416b-b49b-26e4e9023000 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.892829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edec009-bd40-453f-938c-a99172eb4c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.893566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edec009-bd40-453f-938c-a99172eb4c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.893913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edec009-bd40-453f-938c-a99172eb4c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.894217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edec009-bd40-453f-938c-a99172eb4c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.895230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edec009-bd40-453f-938c-a99172eb4c03 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:24.895548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edec009-bd40-453f-938c-a99172eb4c03 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.897709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edec009-bd40-453f-938c-a99172eb4c03 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.916515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 616/1229] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:24.919962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd6049-6601-408b-a2b1-936ca1ab20ad admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:24.933131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd6049-6601-408b-a2b1-936ca1ab20ad admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:24.939421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55216e31-46e5-4bc5-bcb0-b9d33928ca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:24.940480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55216e31-46e5-4bc5-bcb0-b9d33928ca78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:24.940764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55216e31-46e5-4bc5-bcb0-b9d33928ca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:24.941172 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55216e31-46e5-4bc5-bcb0-b9d33928ca78 admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/b06b37b8f23946ebbb5083a877274ea5/roles/252e58e0307c43339c5bc8a0d299fea2` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:24.960970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55216e31-46e5-4bc5-bcb0-b9d33928ca78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=b06b37b8f23946ebbb5083a877274ea5, role_id=252e58e0307c43339c5bc8a0d299fea2)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:24.963738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55216e31-46e5-4bc5-bcb0-b9d33928ca78 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:24.979335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 614/1230] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:31:24 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/b06b37b8f23946ebbb5083a877274ea5/roles/252e58e0307c43339c5bc8a0d299fea2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:31:27.341091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ce4b3-f50f-419f-9cdb-d49f945ef808 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.341657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ce4b3-f50f-419f-9cdb-d49f945ef808 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.341657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ce4b3-f50f-419f-9cdb-d49f945ef808 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.343372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 617/1231] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:27.348869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a24a25-d863-4dcd-be7c-a496265f48e5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.349312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a24a25-d863-4dcd-be7c-a496265f48e5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.349492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a24a25-d863-4dcd-be7c-a496265f48e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.369011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-84a24a25-d863-4dcd-be7c-a496265f48e5 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:27.370403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-84a24a25-d863-4dcd-be7c-a496265f48e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:27.432043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 615/1232] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:27.457080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ce4b3-f50f-419f-9cdb-d49f945ef808 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.469481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ce4b3-f50f-419f-9cdb-d49f945ef808 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.473850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bff3c-ab54-4ba9-acdb-398a90a4d580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.474617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bff3c-ab54-4ba9-acdb-398a90a4d580 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.474883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bff3c-ab54-4ba9-acdb-398a90a4d580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.475145 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948bff3c-ab54-4ba9-acdb-398a90a4d580 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.485888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948bff3c-ab54-4ba9-acdb-398a90a4d580 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:31:27.492843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-948bff3c-ab54-4ba9-acdb-398a90a4d580 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 07 02:31:27.494100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 618/1233] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:27.500215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a24a25-d863-4dcd-be7c-a496265f48e5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.510963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a24a25-d863-4dcd-be7c-a496265f48e5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.515579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c5a55-439e-4578-80fe-7d90a708b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.516229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c5a55-439e-4578-80fe-7d90a708b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.517204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c5a55-439e-4578-80fe-7d90a708b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.517489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c5a55-439e-4578-80fe-7d90a708b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.518255 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c5a55-439e-4578-80fe-7d90a708b7e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:27.518560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c5a55-439e-4578-80fe-7d90a708b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.520257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c5a55-439e-4578-80fe-7d90a708b7e0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.535426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 616/1234] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:27.536674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bff3c-ab54-4ba9-acdb-398a90a4d580 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.549635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948bff3c-ab54-4ba9-acdb-398a90a4d580 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.554392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa06d50-d1e0-4633-8983-011d602c4176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.555169 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa06d50-d1e0-4633-8983-011d602c4176 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.555442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa06d50-d1e0-4633-8983-011d602c4176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.555710 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa06d50-d1e0-4633-8983-011d602c4176 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.566808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa06d50-d1e0-4633-8983-011d602c4176 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.568654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa06d50-d1e0-4633-8983-011d602c4176 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.585630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-4aa06d50-d1e0-4633-8983-011d602c4176 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:27.586923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 619/1235] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:31:27.592753 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c5a55-439e-4578-80fe-7d90a708b7e0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.602403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c5a55-439e-4578-80fe-7d90a708b7e0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.606941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00f2c4-70f8-4863-9ec3-189a50681b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.607585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00f2c4-70f8-4863-9ec3-189a50681b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.607865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00f2c4-70f8-4863-9ec3-189a50681b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.608137 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00f2c4-70f8-4863-9ec3-189a50681b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.608911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00f2c4-70f8-4863-9ec3-189a50681b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:27.609207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00f2c4-70f8-4863-9ec3-189a50681b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.610836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00f2c4-70f8-4863-9ec3-189a50681b0c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.622652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 617/1236] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:27.628635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa06d50-d1e0-4633-8983-011d602c4176 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.639435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa06d50-d1e0-4633-8983-011d602c4176 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.645167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721764-308d-4013-bf4f-12f75f951419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.645953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721764-308d-4013-bf4f-12f75f951419 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.646241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721764-308d-4013-bf4f-12f75f951419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.646592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721764-308d-4013-bf4f-12f75f951419 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.655310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d721764-308d-4013-bf4f-12f75f951419 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.657778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d721764-308d-4013-bf4f-12f75f951419 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.671995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1d721764-308d-4013-bf4f-12f75f951419 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 02:31:27.675361 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 620/1237] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:27.679492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00f2c4-70f8-4863-9ec3-189a50681b0c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.689796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00f2c4-70f8-4863-9ec3-189a50681b0c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.694323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2085f84-5ed5-4091-8d82-2607efd5f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.694972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2085f84-5ed5-4091-8d82-2607efd5f133 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.695255 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2085f84-5ed5-4091-8d82-2607efd5f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.695524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2085f84-5ed5-4091-8d82-2607efd5f133 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.696530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2085f84-5ed5-4091-8d82-2607efd5f133 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:27.696933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2085f84-5ed5-4091-8d82-2607efd5f133 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.698987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2085f84-5ed5-4091-8d82-2607efd5f133 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.720461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 618/1238] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:27.726336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721764-308d-4013-bf4f-12f75f951419 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.737641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721764-308d-4013-bf4f-12f75f951419 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.742722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9330d67-de0f-4ee6-8090-72833db060e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.743421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9330d67-de0f-4ee6-8090-72833db060e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.743810 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9330d67-de0f-4ee6-8090-72833db060e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.744085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9330d67-de0f-4ee6-8090-72833db060e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.753485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9330d67-de0f-4ee6-8090-72833db060e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.755341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9330d67-de0f-4ee6-8090-72833db060e1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.764176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 621/1239] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:31:27.770361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2085f84-5ed5-4091-8d82-2607efd5f133 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.781449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2085f84-5ed5-4091-8d82-2607efd5f133 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.786738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f2ad-8a03-4f38-b9cc-837b0d6780c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.787550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f2ad-8a03-4f38-b9cc-837b0d6780c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.787868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f2ad-8a03-4f38-b9cc-837b0d6780c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.788170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f2ad-8a03-4f38-b9cc-837b0d6780c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.799982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506f2ad-8a03-4f38-b9cc-837b0d6780c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.802070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506f2ad-8a03-4f38-b9cc-837b0d6780c5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.827372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c506f2ad-8a03-4f38-b9cc-837b0d6780c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:27.828794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 619/1240] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:27.835225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9330d67-de0f-4ee6-8090-72833db060e1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.844081 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9330d67-de0f-4ee6-8090-72833db060e1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.848885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79e209-de64-424b-ae03-8acfadb8a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.849580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e209-de64-424b-ae03-8acfadb8a3fc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.849854 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e209-de64-424b-ae03-8acfadb8a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.850144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e209-de64-424b-ae03-8acfadb8a3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.850836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79e209-de64-424b-ae03-8acfadb8a3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:27.851151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79e209-de64-424b-ae03-8acfadb8a3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.852739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79e209-de64-424b-ae03-8acfadb8a3fc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.865619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 622/1241] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:27.872257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f2ad-8a03-4f38-b9cc-837b0d6780c5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.883765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f2ad-8a03-4f38-b9cc-837b0d6780c5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.889287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dfe7f-08cb-4888-9836-2f9902a5367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.890186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dfe7f-08cb-4888-9836-2f9902a5367a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.890487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dfe7f-08cb-4888-9836-2f9902a5367a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.890802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dfe7f-08cb-4888-9836-2f9902a5367a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.897792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dfe7f-08cb-4888-9836-2f9902a5367a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.899860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dfe7f-08cb-4888-9836-2f9902a5367a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.916371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ab2dfe7f-08cb-4888-9836-2f9902a5367a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:31:27.922493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 620/1242] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:27.924720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79e209-de64-424b-ae03-8acfadb8a3fc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.934158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79e209-de64-424b-ae03-8acfadb8a3fc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.939381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf0f3d-4f0f-4e62-8e13-321381996a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.940023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf0f3d-4f0f-4e62-8e13-321381996a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.940295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf0f3d-4f0f-4e62-8e13-321381996a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.940603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf0f3d-4f0f-4e62-8e13-321381996a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.941382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf0f3d-4f0f-4e62-8e13-321381996a03 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:27.941679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf0f3d-4f0f-4e62-8e13-321381996a03 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.943511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf0f3d-4f0f-4e62-8e13-321381996a03 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.955796 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 623/1243] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:27.962450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dfe7f-08cb-4888-9836-2f9902a5367a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:27.972799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dfe7f-08cb-4888-9836-2f9902a5367a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:27.977424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ecb07-d3aa-415c-aa2b-a18aeeccb856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:27.978054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ecb07-d3aa-415c-aa2b-a18aeeccb856 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:27.978327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ecb07-d3aa-415c-aa2b-a18aeeccb856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:27.978598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ecb07-d3aa-415c-aa2b-a18aeeccb856 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:27.979416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ecb07-d3aa-415c-aa2b-a18aeeccb856 admin admin] RBAC: Adding query filter params (role.id=252e58e0307c43339c5bc8a0d299fea2, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=b06b37b8f23946ebbb5083a877274ea5) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:27.979726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ecb07-d3aa-415c-aa2b-a18aeeccb856 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:27.981667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ecb07-d3aa-415c-aa2b-a18aeeccb856 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:27.988054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 621/1244] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:31:27 2022] GET /identity/v3/role_assignments?user.id=b06b37b8f23946ebbb5083a877274ea5&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=252e58e0307c43339c5bc8a0d299fea2 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:30.334223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d983f6-c301-41aa-a486-5a30d294636d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.334761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d983f6-c301-41aa-a486-5a30d294636d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.334852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d983f6-c301-41aa-a486-5a30d294636d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.336668 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 624/1245] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:30.342106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d78924-12cc-40ad-905f-7d7091b7617e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.342580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d78924-12cc-40ad-905f-7d7091b7617e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.342696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d78924-12cc-40ad-905f-7d7091b7617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.360606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d3d78924-12cc-40ad-905f-7d7091b7617e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:30.361795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d3d78924-12cc-40ad-905f-7d7091b7617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:30.369726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 622/1246] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:30.393956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d983f6-c301-41aa-a486-5a30d294636d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.405983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d983f6-c301-41aa-a486-5a30d294636d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.410463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e5b2e-76c4-4c12-8155-19fdab158579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.411237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e5b2e-76c4-4c12-8155-19fdab158579 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.411510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e5b2e-76c4-4c12-8155-19fdab158579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.411777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e5b2e-76c4-4c12-8155-19fdab158579 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.423237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e5b2e-76c4-4c12-8155-19fdab158579 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:31:30.431598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-742e5b2e-76c4-4c12-8155-19fdab158579 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:31:30.433002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 625/1247] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:30.439600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d78924-12cc-40ad-905f-7d7091b7617e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.448665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d78924-12cc-40ad-905f-7d7091b7617e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.453594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52b646-f2c9-41e9-913f-13c0a9085d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.454856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52b646-f2c9-41e9-913f-13c0a9085d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.455109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52b646-f2c9-41e9-913f-13c0a9085d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.455403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52b646-f2c9-41e9-913f-13c0a9085d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.456120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52b646-f2c9-41e9-913f-13c0a9085d38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:30.456493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52b646-f2c9-41e9-913f-13c0a9085d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.458017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52b646-f2c9-41e9-913f-13c0a9085d38 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.466996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 623/1248] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:30.472838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e5b2e-76c4-4c12-8155-19fdab158579 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.484585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e5b2e-76c4-4c12-8155-19fdab158579 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.489240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2e8bb-304f-4d48-b6e2-083d6894fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.490009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2e8bb-304f-4d48-b6e2-083d6894fc3a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.490284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2e8bb-304f-4d48-b6e2-083d6894fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.490553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2e8bb-304f-4d48-b6e2-083d6894fc3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.502359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2e8bb-304f-4d48-b6e2-083d6894fc3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.504507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2e8bb-304f-4d48-b6e2-083d6894fc3a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.522507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-0fa2e8bb-304f-4d48-b6e2-083d6894fc3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:30.523962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 626/1249] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:30.530772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52b646-f2c9-41e9-913f-13c0a9085d38 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.540456 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52b646-f2c9-41e9-913f-13c0a9085d38 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.545326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2979da9-4204-4623-a155-a35d574656ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.545972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2979da9-4204-4623-a155-a35d574656ec admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.546251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2979da9-4204-4623-a155-a35d574656ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.546524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2979da9-4204-4623-a155-a35d574656ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.547254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2979da9-4204-4623-a155-a35d574656ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:30.547584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2979da9-4204-4623-a155-a35d574656ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.549213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2979da9-4204-4623-a155-a35d574656ec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.561156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 624/1250] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:30.567542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2e8bb-304f-4d48-b6e2-083d6894fc3a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.578050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2e8bb-304f-4d48-b6e2-083d6894fc3a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.583694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0a526-61dd-44b0-a8f1-ed51bb324d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.584569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a526-61dd-44b0-a8f1-ed51bb324d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.584870 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a526-61dd-44b0-a8f1-ed51bb324d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.585174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0a526-61dd-44b0-a8f1-ed51bb324d44 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.593152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0a526-61dd-44b0-a8f1-ed51bb324d44 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.595274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0a526-61dd-44b0-a8f1-ed51bb324d44 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.609489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-06c0a526-61dd-44b0-a8f1-ed51bb324d44 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 02:31:30.610739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 627/1251] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:30.617100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2979da9-4204-4623-a155-a35d574656ec admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.627590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2979da9-4204-4623-a155-a35d574656ec admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.632987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed121d8-057d-4f74-981b-0fcefdb97907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.633711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed121d8-057d-4f74-981b-0fcefdb97907 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.633962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed121d8-057d-4f74-981b-0fcefdb97907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.634303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed121d8-057d-4f74-981b-0fcefdb97907 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.635329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed121d8-057d-4f74-981b-0fcefdb97907 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:30.635834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed121d8-057d-4f74-981b-0fcefdb97907 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.637891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed121d8-057d-4f74-981b-0fcefdb97907 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.658882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 625/1252] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:30.664851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0a526-61dd-44b0-a8f1-ed51bb324d44 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.675161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0a526-61dd-44b0-a8f1-ed51bb324d44 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.680379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449a68c-30d2-4e6f-af81-dd43d86f762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.681047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449a68c-30d2-4e6f-af81-dd43d86f762a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.681326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449a68c-30d2-4e6f-af81-dd43d86f762a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.681597 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449a68c-30d2-4e6f-af81-dd43d86f762a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.690949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449a68c-30d2-4e6f-af81-dd43d86f762a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.692955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449a68c-30d2-4e6f-af81-dd43d86f762a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.702953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 628/1253] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:31:30.708873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed121d8-057d-4f74-981b-0fcefdb97907 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.719380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed121d8-057d-4f74-981b-0fcefdb97907 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.724335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc306c-3874-4419-95f7-8f4a6572009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.725338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc306c-3874-4419-95f7-8f4a6572009f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.725594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc306c-3874-4419-95f7-8f4a6572009f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.725869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc306c-3874-4419-95f7-8f4a6572009f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.737755 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc306c-3874-4419-95f7-8f4a6572009f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.739659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc306c-3874-4419-95f7-8f4a6572009f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.758102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-dadc306c-3874-4419-95f7-8f4a6572009f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:30.759361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 626/1254] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:31:30.765041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449a68c-30d2-4e6f-af81-dd43d86f762a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.776699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449a68c-30d2-4e6f-af81-dd43d86f762a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.781851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e643b-9dec-4361-9067-b642c650c294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.782640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e643b-9dec-4361-9067-b642c650c294 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.783017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e643b-9dec-4361-9067-b642c650c294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.783388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e643b-9dec-4361-9067-b642c650c294 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.784216 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e643b-9dec-4361-9067-b642c650c294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:30.784557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e643b-9dec-4361-9067-b642c650c294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.786138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e643b-9dec-4361-9067-b642c650c294 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.798601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 629/1255] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:31:30.804614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc306c-3874-4419-95f7-8f4a6572009f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.816680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc306c-3874-4419-95f7-8f4a6572009f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.823690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a16f3-c106-4331-8e7d-3ef024df94a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.824582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a16f3-c106-4331-8e7d-3ef024df94a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.824873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a16f3-c106-4331-8e7d-3ef024df94a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.825399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a16f3-c106-4331-8e7d-3ef024df94a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.833251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a16f3-c106-4331-8e7d-3ef024df94a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.835503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a16f3-c106-4331-8e7d-3ef024df94a4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.849925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ff4a16f3-c106-4331-8e7d-3ef024df94a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:31:30.851141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 627/1256] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:30.857233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e643b-9dec-4361-9067-b642c650c294 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.867388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e643b-9dec-4361-9067-b642c650c294 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.872474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c77fa8-9ebf-4324-b5c5-570ecf59d34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.873413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77fa8-9ebf-4324-b5c5-570ecf59d34e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.873793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77fa8-9ebf-4324-b5c5-570ecf59d34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.874149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77fa8-9ebf-4324-b5c5-570ecf59d34e admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.874961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c77fa8-9ebf-4324-b5c5-570ecf59d34e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:30.875272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c77fa8-9ebf-4324-b5c5-570ecf59d34e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.877715 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c77fa8-9ebf-4324-b5c5-570ecf59d34e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.890920 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 630/1257] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:30.897486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a16f3-c106-4331-8e7d-3ef024df94a4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:30.911349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a16f3-c106-4331-8e7d-3ef024df94a4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:30.916756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3a530-e074-4a8b-ac87-0fb0306ef16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:30.917450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a530-e074-4a8b-ac87-0fb0306ef16b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:30.917736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a530-e074-4a8b-ac87-0fb0306ef16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:30.918007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3a530-e074-4a8b-ac87-0fb0306ef16b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:30.918843 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a530-e074-4a8b-ac87-0fb0306ef16b admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=b06b37b8f23946ebbb5083a877274ea5) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:30.919153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a530-e074-4a8b-ac87-0fb0306ef16b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:30.921082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3a530-e074-4a8b-ac87-0fb0306ef16b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:30.927857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 628/1258] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:31:30 2022] GET /identity/v3/role_assignments?user.id=b06b37b8f23946ebbb5083a877274ea5&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:33.204708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619134e3-795f-4406-882f-f272e7a54059 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.205243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619134e3-795f-4406-882f-f272e7a54059 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.205243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619134e3-795f-4406-882f-f272e7a54059 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.206994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 631/1259] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:33.212504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376652e-9e3c-4cce-bec2-a3d044657336 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.212957 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376652e-9e3c-4cce-bec2-a3d044657336 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.213048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376652e-9e3c-4cce-bec2-a3d044657336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.231296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a376652e-9e3c-4cce-bec2-a3d044657336 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:33.232522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a376652e-9e3c-4cce-bec2-a3d044657336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:33.240166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 629/1260] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:33.263268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619134e3-795f-4406-882f-f272e7a54059 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.276366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619134e3-795f-4406-882f-f272e7a54059 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.280748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf78e-692a-435a-a340-af123a8f39da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.281521 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf78e-692a-435a-a340-af123a8f39da admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.281794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf78e-692a-435a-a340-af123a8f39da admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.282700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf78e-692a-435a-a340-af123a8f39da admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.292941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf78e-692a-435a-a340-af123a8f39da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:31:33.299606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-4a3bf78e-692a-435a-a340-af123a8f39da admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:31:33.300826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 632/1261] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:33.307052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376652e-9e3c-4cce-bec2-a3d044657336 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.317617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376652e-9e3c-4cce-bec2-a3d044657336 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.323257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc344a9b-e85c-4541-baf1-b9b10b2a34c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.323982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc344a9b-e85c-4541-baf1-b9b10b2a34c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.324254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc344a9b-e85c-4541-baf1-b9b10b2a34c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.324564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc344a9b-e85c-4541-baf1-b9b10b2a34c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.325584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc344a9b-e85c-4541-baf1-b9b10b2a34c2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:33.325887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc344a9b-e85c-4541-baf1-b9b10b2a34c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.327486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc344a9b-e85c-4541-baf1-b9b10b2a34c2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.337428 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 630/1262] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:33.343547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf78e-692a-435a-a340-af123a8f39da admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.354224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf78e-692a-435a-a340-af123a8f39da admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.358915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3e46c-03ce-4751-acc5-afd9077cd4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.359724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e46c-03ce-4751-acc5-afd9077cd4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.360034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e46c-03ce-4751-acc5-afd9077cd4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.360304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e46c-03ce-4751-acc5-afd9077cd4f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.371434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3e46c-03ce-4751-acc5-afd9077cd4f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.373324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3e46c-03ce-4751-acc5-afd9077cd4f7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.392137 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-b7d3e46c-03ce-4751-acc5-afd9077cd4f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:33.393426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 633/1263] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:33.399303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc344a9b-e85c-4541-baf1-b9b10b2a34c2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.409507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc344a9b-e85c-4541-baf1-b9b10b2a34c2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.414943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a28e68-1ae3-44f4-bfc1-5ea1a6b2d41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.415626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a28e68-1ae3-44f4-bfc1-5ea1a6b2d41b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.415912 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a28e68-1ae3-44f4-bfc1-5ea1a6b2d41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.416190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a28e68-1ae3-44f4-bfc1-5ea1a6b2d41b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.416971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a28e68-1ae3-44f4-bfc1-5ea1a6b2d41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:33.417281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a28e68-1ae3-44f4-bfc1-5ea1a6b2d41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.418909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a28e68-1ae3-44f4-bfc1-5ea1a6b2d41b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.431705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 631/1264] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:33.437340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3e46c-03ce-4751-acc5-afd9077cd4f7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.448320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3e46c-03ce-4751-acc5-afd9077cd4f7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.454537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af88bf5-972f-4987-a82c-de2ae02e9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.455497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af88bf5-972f-4987-a82c-de2ae02e9644 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.455785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af88bf5-972f-4987-a82c-de2ae02e9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.456200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af88bf5-972f-4987-a82c-de2ae02e9644 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.464117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af88bf5-972f-4987-a82c-de2ae02e9644 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.466323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af88bf5-972f-4987-a82c-de2ae02e9644 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.480617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-2af88bf5-972f-4987-a82c-de2ae02e9644 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 02:31:33.481875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 634/1265] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:33.487673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a28e68-1ae3-44f4-bfc1-5ea1a6b2d41b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.498289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a28e68-1ae3-44f4-bfc1-5ea1a6b2d41b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.503431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbe4a6-7810-421a-a03a-a845f5301840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.504163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbe4a6-7810-421a-a03a-a845f5301840 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.504476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbe4a6-7810-421a-a03a-a845f5301840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.504805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbe4a6-7810-421a-a03a-a845f5301840 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.505746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbe4a6-7810-421a-a03a-a845f5301840 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:33.506084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbe4a6-7810-421a-a03a-a845f5301840 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.508103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbe4a6-7810-421a-a03a-a845f5301840 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.527920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 632/1266] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:33.533581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af88bf5-972f-4987-a82c-de2ae02e9644 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.543319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af88bf5-972f-4987-a82c-de2ae02e9644 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.548495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691c959-6f48-4f33-aeed-362320751e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.549353 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691c959-6f48-4f33-aeed-362320751e6b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.549675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691c959-6f48-4f33-aeed-362320751e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.550025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691c959-6f48-4f33-aeed-362320751e6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.560893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691c959-6f48-4f33-aeed-362320751e6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.562929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691c959-6f48-4f33-aeed-362320751e6b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.582205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-1691c959-6f48-4f33-aeed-362320751e6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:33.583368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 635/1267] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:33.589214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbe4a6-7810-421a-a03a-a845f5301840 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.600741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbe4a6-7810-421a-a03a-a845f5301840 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.605937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ec81d-f7d5-450d-8a1f-7f709a04ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.606585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec81d-f7d5-450d-8a1f-7f709a04ab7e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.606862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec81d-f7d5-450d-8a1f-7f709a04ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.607132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ec81d-f7d5-450d-8a1f-7f709a04ab7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.607857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ec81d-f7d5-450d-8a1f-7f709a04ab7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:33.608156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ec81d-f7d5-450d-8a1f-7f709a04ab7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.609790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ec81d-f7d5-450d-8a1f-7f709a04ab7e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.626497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 633/1268] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:33.628111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691c959-6f48-4f33-aeed-362320751e6b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.640640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691c959-6f48-4f33-aeed-362320751e6b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.646212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b9ff4-babe-4a8a-8de0-24a32f25ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.646991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9ff4-babe-4a8a-8de0-24a32f25ff8f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.647270 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9ff4-babe-4a8a-8de0-24a32f25ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.647538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9ff4-babe-4a8a-8de0-24a32f25ff8f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.655392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b9ff4-babe-4a8a-8de0-24a32f25ff8f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.657747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b9ff4-babe-4a8a-8de0-24a32f25ff8f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.673106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-621b9ff4-babe-4a8a-8de0-24a32f25ff8f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:31:33.674397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 636/1269] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:33.680441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ec81d-f7d5-450d-8a1f-7f709a04ab7e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.692331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ec81d-f7d5-450d-8a1f-7f709a04ab7e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.699702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf63b11-82ce-4478-9303-7d53f340f895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.700839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf63b11-82ce-4478-9303-7d53f340f895 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.701219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf63b11-82ce-4478-9303-7d53f340f895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.701498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf63b11-82ce-4478-9303-7d53f340f895 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.702545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf63b11-82ce-4478-9303-7d53f340f895 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:33.702900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf63b11-82ce-4478-9303-7d53f340f895 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.705192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf63b11-82ce-4478-9303-7d53f340f895 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.719214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 634/1270] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:33.726010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b9ff4-babe-4a8a-8de0-24a32f25ff8f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:33.737741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b9ff4-babe-4a8a-8de0-24a32f25ff8f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:33.742980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b62a-0cd0-4bf7-a0fe-b50b8e42d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:33.743807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b62a-0cd0-4bf7-a0fe-b50b8e42d232 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:33.744078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b62a-0cd0-4bf7-a0fe-b50b8e42d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:33.744356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b62a-0cd0-4bf7-a0fe-b50b8e42d232 admin admin] PATH_INFO: `/v3/projects/42d4c002199847628d4f618bad7022db/users/b06b37b8f23946ebbb5083a877274ea5/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:33.746361 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b62a-0cd0-4bf7-a0fe-b50b8e42d232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d4c002199847628d4f618bad7022db, user_id=b06b37b8f23946ebbb5083a877274ea5, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:33.748965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b62a-0cd0-4bf7-a0fe-b50b8e42d232 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:33.765795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 637/1271] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Feb 7 02:31:33 2022] PUT /identity/v3/projects/42d4c002199847628d4f618bad7022db/users/b06b37b8f23946ebbb5083a877274ea5/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:31:35.970659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ec83-a4ea-4b3a-a6ec-673a04271951 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:35.971208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ec83-a4ea-4b3a-a6ec-673a04271951 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:35.971208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ec83-a4ea-4b3a-a6ec-673a04271951 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:35.972990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 635/1272] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:35.978379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47896-0f39-4506-8535-0bd878a43189 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:35.978834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47896-0f39-4506-8535-0bd878a43189 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:35.978924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47896-0f39-4506-8535-0bd878a43189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:35.997176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3ee47896-0f39-4506-8535-0bd878a43189 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:35.998355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3ee47896-0f39-4506-8535-0bd878a43189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:36.058832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 638/1273] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:31:36.086231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ec83-a4ea-4b3a-a6ec-673a04271951 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.101107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ec83-a4ea-4b3a-a6ec-673a04271951 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.106182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de148f6a-6883-4fb8-bd78-9216d4b08783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.107232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de148f6a-6883-4fb8-bd78-9216d4b08783 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.107502 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de148f6a-6883-4fb8-bd78-9216d4b08783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.107831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de148f6a-6883-4fb8-bd78-9216d4b08783 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.119665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de148f6a-6883-4fb8-bd78-9216d4b08783 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 07 02:31:36.127333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-de148f6a-6883-4fb8-bd78-9216d4b08783 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 07 02:31:36.128594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 636/1274] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:36.142101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47896-0f39-4506-8535-0bd878a43189 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.151439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47896-0f39-4506-8535-0bd878a43189 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.156102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf6159-6b6c-4361-8725-539db759e32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.157460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf6159-6b6c-4361-8725-539db759e32e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.157733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf6159-6b6c-4361-8725-539db759e32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.157996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf6159-6b6c-4361-8725-539db759e32e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.158759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf6159-6b6c-4361-8725-539db759e32e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:36.159056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf6159-6b6c-4361-8725-539db759e32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.160730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf6159-6b6c-4361-8725-539db759e32e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.169925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 639/1275] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:36.175901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de148f6a-6883-4fb8-bd78-9216d4b08783 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.186713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de148f6a-6883-4fb8-bd78-9216d4b08783 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.191443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910e058-7dde-49c5-9ca2-55fb59b9c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.192243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910e058-7dde-49c5-9ca2-55fb59b9c1af admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.192547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910e058-7dde-49c5-9ca2-55fb59b9c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.192812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910e058-7dde-49c5-9ca2-55fb59b9c1af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.204568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910e058-7dde-49c5-9ca2-55fb59b9c1af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.206420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910e058-7dde-49c5-9ca2-55fb59b9c1af admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.225143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-5910e058-7dde-49c5-9ca2-55fb59b9c1af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:36.226316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 637/1276] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:36.232255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf6159-6b6c-4361-8725-539db759e32e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.242174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf6159-6b6c-4361-8725-539db759e32e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.246815 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b80650-95a1-43fc-8f52-dc2f985da532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.247467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b80650-95a1-43fc-8f52-dc2f985da532 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.247741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b80650-95a1-43fc-8f52-dc2f985da532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.248006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b80650-95a1-43fc-8f52-dc2f985da532 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.248771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b80650-95a1-43fc-8f52-dc2f985da532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:36.249072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b80650-95a1-43fc-8f52-dc2f985da532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.250719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b80650-95a1-43fc-8f52-dc2f985da532 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.263479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 640/1277] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:36.270152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910e058-7dde-49c5-9ca2-55fb59b9c1af admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.280648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910e058-7dde-49c5-9ca2-55fb59b9c1af admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.285779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835eb8b-10ce-40ac-846d-53e086626441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.286588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835eb8b-10ce-40ac-846d-53e086626441 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.286861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835eb8b-10ce-40ac-846d-53e086626441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.287128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835eb8b-10ce-40ac-846d-53e086626441 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.295148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835eb8b-10ce-40ac-846d-53e086626441 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.297206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835eb8b-10ce-40ac-846d-53e086626441 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.311939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-8835eb8b-10ce-40ac-846d-53e086626441 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 07 02:31:36.313753 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 638/1278] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:36.319813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b80650-95a1-43fc-8f52-dc2f985da532 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.331758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b80650-95a1-43fc-8f52-dc2f985da532 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.336418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb52796-88e3-4c01-9abf-23b8d4e3d9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.337094 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb52796-88e3-4c01-9abf-23b8d4e3d9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.337371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb52796-88e3-4c01-9abf-23b8d4e3d9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.337640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb52796-88e3-4c01-9abf-23b8d4e3d9d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.338487 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb52796-88e3-4c01-9abf-23b8d4e3d9d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:36.338789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb52796-88e3-4c01-9abf-23b8d4e3d9d7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.340684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb52796-88e3-4c01-9abf-23b8d4e3d9d7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.359710 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 641/1279] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:36.365774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835eb8b-10ce-40ac-846d-53e086626441 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.376309 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835eb8b-10ce-40ac-846d-53e086626441 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.381015 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acb316-88aa-44c1-b859-58ea63d3d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.381671 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acb316-88aa-44c1-b859-58ea63d3d31c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.381951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acb316-88aa-44c1-b859-58ea63d3d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.382223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acb316-88aa-44c1-b859-58ea63d3d31c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.390843 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acb316-88aa-44c1-b859-58ea63d3d31c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.393291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acb316-88aa-44c1-b859-58ea63d3d31c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.402973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 639/1280] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:31:36.409256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb52796-88e3-4c01-9abf-23b8d4e3d9d7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.419153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb52796-88e3-4c01-9abf-23b8d4e3d9d7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.423902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3a64-9b47-4cae-8764-cf429f996c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.424812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3a64-9b47-4cae-8764-cf429f996c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.425156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3a64-9b47-4cae-8764-cf429f996c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.425492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f3a64-9b47-4cae-8764-cf429f996c29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.436613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f3a64-9b47-4cae-8764-cf429f996c29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.439034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f3a64-9b47-4cae-8764-cf429f996c29 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.457181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-c23f3a64-9b47-4cae-8764-cf429f996c29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 07 02:31:36.458441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 642/1281] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:36.464487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acb316-88aa-44c1-b859-58ea63d3d31c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.473800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acb316-88aa-44c1-b859-58ea63d3d31c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.479486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9360c40-dde2-4e82-8e97-2ad8c757e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.479486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9360c40-dde2-4e82-8e97-2ad8c757e602 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.479486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9360c40-dde2-4e82-8e97-2ad8c757e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.479778 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9360c40-dde2-4e82-8e97-2ad8c757e602 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.480396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9360c40-dde2-4e82-8e97-2ad8c757e602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:36.480702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9360c40-dde2-4e82-8e97-2ad8c757e602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.482274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9360c40-dde2-4e82-8e97-2ad8c757e602 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.493849 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 640/1282] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:36.499681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3a64-9b47-4cae-8764-cf429f996c29 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.510160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f3a64-9b47-4cae-8764-cf429f996c29 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.515506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcec67c-1354-462c-b473-e58abe868e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.516881 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcec67c-1354-462c-b473-e58abe868e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.517159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcec67c-1354-462c-b473-e58abe868e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.517427 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcec67c-1354-462c-b473-e58abe868e0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.524238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcec67c-1354-462c-b473-e58abe868e0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.526202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcec67c-1354-462c-b473-e58abe868e0e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.538842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING keystone.server.flask.application [None req-5dcec67c-1354-462c-b473-e58abe868e0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 07 02:31:36.540161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 643/1283] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:36.545894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9360c40-dde2-4e82-8e97-2ad8c757e602 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.555749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9360c40-dde2-4e82-8e97-2ad8c757e602 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.560429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335ea20-d517-45b2-959d-2bd4d6900b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.561145 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335ea20-d517-45b2-959d-2bd4d6900b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.561496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335ea20-d517-45b2-959d-2bd4d6900b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.561838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335ea20-d517-45b2-959d-2bd4d6900b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.562700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335ea20-d517-45b2-959d-2bd4d6900b5c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:36.563595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335ea20-d517-45b2-959d-2bd4d6900b5c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.565505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335ea20-d517-45b2-959d-2bd4d6900b5c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.578278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 641/1284] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:36.584658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcec67c-1354-462c-b473-e58abe868e0e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:36.595196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcec67c-1354-462c-b473-e58abe868e0e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:36.599788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc00b6-ecea-49e1-b9d5-3a35a3c7565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:36.600504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc00b6-ecea-49e1-b9d5-3a35a3c7565e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:36.600785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc00b6-ecea-49e1-b9d5-3a35a3c7565e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:36.601059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc00b6-ecea-49e1-b9d5-3a35a3c7565e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:36.601885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc00b6-ecea-49e1-b9d5-3a35a3c7565e admin admin] RBAC: Adding query filter params (role.id=d6a85718b9d24da5a6b6eaf4dd99d561, scope.project.id=42d4c002199847628d4f618bad7022db, user.id=b06b37b8f23946ebbb5083a877274ea5) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:36.602192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc00b6-ecea-49e1-b9d5-3a35a3c7565e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:36.604016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc00b6-ecea-49e1-b9d5-3a35a3c7565e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:36.609898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 644/1285] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Feb 7 02:31:36 2022] GET /identity/v3/role_assignments?user.id=b06b37b8f23946ebbb5083a877274ea5&scope.project.id=42d4c002199847628d4f618bad7022db&role.id=d6a85718b9d24da5a6b6eaf4dd99d561 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:38.833088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9ac52-ad31-4d91-a8fe-59d3e3009b38 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:38.833629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9ac52-ad31-4d91-a8fe-59d3e3009b38 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:38.833629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9ac52-ad31-4d91-a8fe-59d3e3009b38 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:38.835409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 642/1286] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:38.840759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7630f-6c1d-4efa-ac4c-dd868e62436c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:38.841170 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7630f-6c1d-4efa-ac4c-dd868e62436c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:38.841281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7630f-6c1d-4efa-ac4c-dd868e62436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:38.859676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-83e7630f-6c1d-4efa-ac4c-dd868e62436c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:38.860901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-83e7630f-6c1d-4efa-ac4c-dd868e62436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:38.868369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 645/1287] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:38.890650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9ac52-ad31-4d91-a8fe-59d3e3009b38 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:38.903139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9ac52-ad31-4d91-a8fe-59d3e3009b38 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:38.907468 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c2c5b-553b-4b8e-94bd-dfb7f9758d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:38.908229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2c5b-553b-4b8e-94bd-dfb7f9758d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:38.908540 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2c5b-553b-4b8e-94bd-dfb7f9758d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:38.908812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c2c5b-553b-4b8e-94bd-dfb7f9758d8a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:38.909468 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c2c5b-553b-4b8e-94bd-dfb7f9758d8a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:38.911031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c2c5b-553b-4b8e-94bd-dfb7f9758d8a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:38.921623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7c0c2c5b-553b-4b8e-94bd-dfb7f9758d8a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 07 02:31:38.923256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 643/1288] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:31:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:38.928745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7630f-6c1d-4efa-ac4c-dd868e62436c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:38.937413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7630f-6c1d-4efa-ac4c-dd868e62436c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:38.942586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57bf85-0795-4488-b5e5-4e4e92872978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:38.943219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57bf85-0795-4488-b5e5-4e4e92872978 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:38.943500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57bf85-0795-4488-b5e5-4e4e92872978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:38.943774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57bf85-0795-4488-b5e5-4e4e92872978 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:38.944518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57bf85-0795-4488-b5e5-4e4e92872978 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:38.944822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57bf85-0795-4488-b5e5-4e4e92872978 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:38.946388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57bf85-0795-4488-b5e5-4e4e92872978 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:38.951445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 646/1289] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Feb 7 02:31:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:38.956231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c2c5b-553b-4b8e-94bd-dfb7f9758d8a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:38.965382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c2c5b-553b-4b8e-94bd-dfb7f9758d8a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:38.969820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b9e34-6f03-42a6-b26a-bb9b1dfd3d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:38.970424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b9e34-6f03-42a6-b26a-bb9b1dfd3d1a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:38.970698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b9e34-6f03-42a6-b26a-bb9b1dfd3d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:38.970965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b9e34-6f03-42a6-b26a-bb9b1dfd3d1a admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:38.971656 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b9e34-6f03-42a6-b26a-bb9b1dfd3d1a admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:38.971954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b9e34-6f03-42a6-b26a-bb9b1dfd3d1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:38.973509 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b9e34-6f03-42a6-b26a-bb9b1dfd3d1a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:38.977719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 644/1290] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Feb 7 02:31:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:41.182049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917ac2f-d03e-4dc7-b869-0954b80d8b9f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:41.182612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917ac2f-d03e-4dc7-b869-0954b80d8b9f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:41.182612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917ac2f-d03e-4dc7-b869-0954b80d8b9f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:41.184337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 647/1291] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:31:41.190180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed708-f520-4902-98a4-e78d4558e871 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:41.190624 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed708-f520-4902-98a4-e78d4558e871 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:41.190723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bed708-f520-4902-98a4-e78d4558e871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:41.208220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b7bed708-f520-4902-98a4-e78d4558e871 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:41.209419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b7bed708-f520-4902-98a4-e78d4558e871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:41.217030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 645/1292] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:41.239628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917ac2f-d03e-4dc7-b869-0954b80d8b9f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:41.252037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917ac2f-d03e-4dc7-b869-0954b80d8b9f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:41.256321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5008b7-ceb3-45cb-b1e7-58fcb10bf612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:41.257053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5008b7-ceb3-45cb-b1e7-58fcb10bf612 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:41.257332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5008b7-ceb3-45cb-b1e7-58fcb10bf612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:41.257605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5008b7-ceb3-45cb-b1e7-58fcb10bf612 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:41.258338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5008b7-ceb3-45cb-b1e7-58fcb10bf612 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:41.259913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5008b7-ceb3-45cb-b1e7-58fcb10bf612 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:41.272314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 648/1293] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Feb 7 02:31:41 2022] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:31:43.478904 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466201-e5bc-477a-a448-58551e27a0f1 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:43.479457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466201-e5bc-477a-a448-58551e27a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:43.479457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88466201-e5bc-477a-a448-58551e27a0f1 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:43.481259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 646/1294] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:43.486493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3fc48-a783-40df-9673-6ff780a5673c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:43.486913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3fc48-a783-40df-9673-6ff780a5673c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:43.487040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3fc48-a783-40df-9673-6ff780a5673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:43.504217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c2f3fc48-a783-40df-9673-6ff780a5673c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:43.505414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c2f3fc48-a783-40df-9673-6ff780a5673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:43.522363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 649/1295] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:43 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:43.556180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88466201-e5bc-477a-a448-58551e27a0f1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:43.568112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88466201-e5bc-477a-a448-58551e27a0f1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:43.572434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645f70-de94-4ab8-8d40-f651324129a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:43.573199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645f70-de94-4ab8-8d40-f651324129a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:43.573475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645f70-de94-4ab8-8d40-f651324129a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:43.573741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e645f70-de94-4ab8-8d40-f651324129a6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:43.574395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e645f70-de94-4ab8-8d40-f651324129a6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:43.576221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e645f70-de94-4ab8-8d40-f651324129a6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:43.587409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0e645f70-de94-4ab8-8d40-f651324129a6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 07 02:31:43.588539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 647/1296] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:31:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 07 02:31:43.594846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3fc48-a783-40df-9673-6ff780a5673c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:43.603558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3fc48-a783-40df-9673-6ff780a5673c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:43.608008 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c72a7d-8ccc-4c23-8948-cf98109cbc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:43.608683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c72a7d-8ccc-4c23-8948-cf98109cbc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:43.608961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c72a7d-8ccc-4c23-8948-cf98109cbc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:43.609235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c72a7d-8ccc-4c23-8948-cf98109cbc54 admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:43.609941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c72a7d-8ccc-4c23-8948-cf98109cbc54 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:43.610242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c72a7d-8ccc-4c23-8948-cf98109cbc54 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:43.611809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c72a7d-8ccc-4c23-8948-cf98109cbc54 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:43.616789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 650/1297] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Feb 7 02:31:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:43.622093 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645f70-de94-4ab8-8d40-f651324129a6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:43.631462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e645f70-de94-4ab8-8d40-f651324129a6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:43.635919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb4be-5b58-466a-9dd4-02ced042c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:43.636570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb4be-5b58-466a-9dd4-02ced042c8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:43.636852 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb4be-5b58-466a-9dd4-02ced042c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:43.637122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb4be-5b58-466a-9dd4-02ced042c8e5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:43.637904 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bb4be-5b58-466a-9dd4-02ced042c8e5 admin admin] RBAC: Adding query filter params (interface=public, service_id=5c5c47eca9bb45c298a51dd8d3b86e57, region_id=RegionOne) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:43.638209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bb4be-5b58-466a-9dd4-02ced042c8e5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:43.639762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bb4be-5b58-466a-9dd4-02ced042c8e5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:43.645121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 648/1298] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Feb 7 02:31:43 2022] GET /identity/v3/endpoints?service_id=5c5c47eca9bb45c298a51dd8d3b86e57&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:43.650446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c72a7d-8ccc-4c23-8948-cf98109cbc54 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:43.660510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c72a7d-8ccc-4c23-8948-cf98109cbc54 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:43.665006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab2711-c12c-489f-ae56-fc700d66ebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:43.665634 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab2711-c12c-489f-ae56-fc700d66ebbc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:43.665917 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab2711-c12c-489f-ae56-fc700d66ebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:43.666190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab2711-c12c-489f-ae56-fc700d66ebbc admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:43.666865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab2711-c12c-489f-ae56-fc700d66ebbc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:43.668455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab2711-c12c-489f-ae56-fc700d66ebbc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:43.675196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 651/1299] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:31:43 2022] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:31:45.862454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8d8f3-87ae-4299-ba5a-0e478304635d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:45.862986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8d8f3-87ae-4299-ba5a-0e478304635d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:45.862986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8d8f3-87ae-4299-ba5a-0e478304635d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:45.864816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 649/1300] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:31:45.869902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8ea7-70ef-49d0-b685-6220507d534b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:45.870285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8ea7-70ef-49d0-b685-6220507d534b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:45.870449 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f8ea7-70ef-49d0-b685-6220507d534b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:45.887430 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-dd0f8ea7-70ef-49d0-b685-6220507d534b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:31:45.888616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dd0f8ea7-70ef-49d0-b685-6220507d534b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:31:45.896563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 652/1301] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:31:45 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:31:45.919559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8d8f3-87ae-4299-ba5a-0e478304635d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:45.931407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8d8f3-87ae-4299-ba5a-0e478304635d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:45.935695 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54d5ba-e4a7-4970-91d4-e0647a60d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:45.936483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54d5ba-e4a7-4970-91d4-e0647a60d9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:45.936764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54d5ba-e4a7-4970-91d4-e0647a60d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:45.937062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54d5ba-e4a7-4970-91d4-e0647a60d9f9 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:45.937710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54d5ba-e4a7-4970-91d4-e0647a60d9f9 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:45.939310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af54d5ba-e4a7-4970-91d4-e0647a60d9f9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:45.950192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-af54d5ba-e4a7-4970-91d4-e0647a60d9f9 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 07 02:31:45.951324 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 650/1302] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Feb 7 02:31:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 07 02:31:45.958369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8ea7-70ef-49d0-b685-6220507d534b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:45.967190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f8ea7-70ef-49d0-b685-6220507d534b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:45.972269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2177b6e-48e1-489d-af4a-229e35a99b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:45.972930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177b6e-48e1-489d-af4a-229e35a99b9a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:45.973206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177b6e-48e1-489d-af4a-229e35a99b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:45.973475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2177b6e-48e1-489d-af4a-229e35a99b9a admin admin] PATH_INFO: `/v3/services` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:45.974179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2177b6e-48e1-489d-af4a-229e35a99b9a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:31:45.974478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2177b6e-48e1-489d-af4a-229e35a99b9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:45.976045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2177b6e-48e1-489d-af4a-229e35a99b9a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:45.980964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 653/1303] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Feb 7 02:31:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:31:45.986093 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54d5ba-e4a7-4970-91d4-e0647a60d9f9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:31:45.995907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54d5ba-e4a7-4970-91d4-e0647a60d9f9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:31:46.000337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f1920-7373-48e4-a9d3-4828fe986433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:31:46.000970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1920-7373-48e4-a9d3-4828fe986433 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:31:46.001250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1920-7373-48e4-a9d3-4828fe986433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:31:46.001522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1920-7373-48e4-a9d3-4828fe986433 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:31:46.002251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f1920-7373-48e4-a9d3-4828fe986433 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:31:46.003794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f1920-7373-48e4-a9d3-4828fe986433 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:31:46.021670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 651/1304] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Feb 7 02:31:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:32:48.285449 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1accc43-af75-4cc0-8aca-875936c3ab66 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:48.286474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1accc43-af75-4cc0-8aca-875936c3ab66 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:48.286898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1accc43-af75-4cc0-8aca-875936c3ab66 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:48.294551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652e177-c115-4bdd-ba5f-5feccab5ed1d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:48.295954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652e177-c115-4bdd-ba5f-5feccab5ed1d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:48.296412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652e177-c115-4bdd-ba5f-5feccab5ed1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:48.300025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 654/1305] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:32:48 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:32:48.393467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3652e177-c115-4bdd-ba5f-5feccab5ed1d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:32:48.394917 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3652e177-c115-4bdd-ba5f-5feccab5ed1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:48.515409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 652/1306] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:32:48.521326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1accc43-af75-4cc0-8aca-875936c3ab66 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:32:48.523202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f1accc43-af75-4cc0-8aca-875936c3ab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:48.829934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1accc43-af75-4cc0-8aca-875936c3ab66 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:32:48.951535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f301f7-b4d8-482f-90f0-064d1fd7c04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:32:48.952234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f301f7-b4d8-482f-90f0-064d1fd7c04f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:48.952590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f301f7-b4d8-482f-90f0-064d1fd7c04f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:48.953160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f301f7-b4d8-482f-90f0-064d1fd7c04f admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:48.954101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f301f7-b4d8-482f-90f0-064d1fd7c04f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:32:48.956304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f301f7-b4d8-482f-90f0-064d1fd7c04f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:32:48.977810 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 655/1307] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:32:48 2022] GET /identity/v3/projects => generated 2553 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:32:51.313930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb93893-6f4f-4bed-be74-573a311664e6 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:51.314454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb93893-6f4f-4bed-be74-573a311664e6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:51.314454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb93893-6f4f-4bed-be74-573a311664e6 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:51.316173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 653/1308] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:32:51.321710 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164079bf-33a5-4286-a391-254e064fb6ef None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:51.322122 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164079bf-33a5-4286-a391-254e064fb6ef None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:51.322263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164079bf-33a5-4286-a391-254e064fb6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:51.390166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-164079bf-33a5-4286-a391-254e064fb6ef None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:32:51.391357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-164079bf-33a5-4286-a391-254e064fb6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:51.487467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 656/1309] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:32:51.513273 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb93893-6f4f-4bed-be74-573a311664e6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:32:51.514873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1eb93893-6f4f-4bed-be74-573a311664e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:51.634084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb93893-6f4f-4bed-be74-573a311664e6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:32:51.724053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd59bf-7233-4cea-89d5-ac3cef4f3ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:32:51.724740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd59bf-7233-4cea-89d5-ac3cef4f3ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:51.725017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd59bf-7233-4cea-89d5-ac3cef4f3ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:51.725285 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd59bf-7233-4cea-89d5-ac3cef4f3ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:51.726014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd59bf-7233-4cea-89d5-ac3cef4f3ec1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:32:51.727836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd59bf-7233-4cea-89d5-ac3cef4f3ec1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:32:51.745927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 654/1310] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:32:51 2022] GET /identity/v3/projects => generated 2553 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:32:54.062259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306d6-8b00-4bbb-8299-fbb1c740d152 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:54.062758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306d6-8b00-4bbb-8299-fbb1c740d152 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:54.062758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306d6-8b00-4bbb-8299-fbb1c740d152 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:54.064587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 657/1311] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:32:54.070430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97766-8334-46d4-9dc5-1d65ba8276a8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:54.070952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97766-8334-46d4-9dc5-1d65ba8276a8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:54.070952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97766-8334-46d4-9dc5-1d65ba8276a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:54.141772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-27f97766-8334-46d4-9dc5-1d65ba8276a8 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:32:54.142965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-27f97766-8334-46d4-9dc5-1d65ba8276a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:54.235068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 655/1312] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:32:54.288293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a757d-67d3-4634-962f-87e16801a6d4 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:54.288628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a757d-67d3-4634-962f-87e16801a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:54.288907 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a757d-67d3-4634-962f-87e16801a6d4 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:54.290681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 658/1313] 10.222.0.15 () {54 vars in 964 bytes} [Mon Feb 7 02:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:32:54.296985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8295d-7ea3-4561-9946-635df423cdb0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:54.297274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8295d-7ea3-4561-9946-635df423cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:54.297549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8295d-7ea3-4561-9946-635df423cdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:54.369318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4eb8295d-7ea3-4561-9946-635df423cdb0 None None] MFA Rules not processed for user `b3922641f7c846da98457824bec58652`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:32:54.370436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4eb8295d-7ea3-4561-9946-635df423cdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:54.442959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 656/1314] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Feb 7 02:32:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:32:54.453264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a757d-67d3-4634-962f-87e16801a6d4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:32:54.454846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-436a757d-67d3-4634-962f-87e16801a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:54.554197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a757d-67d3-4634-962f-87e16801a6d4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:32:54.624373 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38696499-823c-4d5e-80c2-4013e78ee046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:32:54.624949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38696499-823c-4d5e-80c2-4013e78ee046 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:54.625225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38696499-823c-4d5e-80c2-4013e78ee046 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:54.625494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38696499-823c-4d5e-80c2-4013e78ee046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:54.627110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-38696499-823c-4d5e-80c2-4013e78ee046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:54.729923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38696499-823c-4d5e-80c2-4013e78ee046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:32:54.731313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38696499-823c-4d5e-80c2-4013e78ee046 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:32:54.750010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 659/1315] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:32:57.201406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de445ac-b3ef-4fa7-bd2f-539dfa76bba2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:57.201951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de445ac-b3ef-4fa7-bd2f-539dfa76bba2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:57.201951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de445ac-b3ef-4fa7-bd2f-539dfa76bba2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:57.203762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 657/1316] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:32:57.208857 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2283aaa-169d-46ff-8561-faff9782578b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:57.209299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2283aaa-169d-46ff-8561-faff9782578b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:57.209443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2283aaa-169d-46ff-8561-faff9782578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:57.271207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f2283aaa-169d-46ff-8561-faff9782578b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:32:57.272415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f2283aaa-169d-46ff-8561-faff9782578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:57.363635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 660/1317] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:32:57.396806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de445ac-b3ef-4fa7-bd2f-539dfa76bba2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:32:57.398308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4de445ac-b3ef-4fa7-bd2f-539dfa76bba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:57.518577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de445ac-b3ef-4fa7-bd2f-539dfa76bba2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:32:57.606925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5759bdb-b7d4-455a-ab4d-1769edc45f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:32:57.607771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5759bdb-b7d4-455a-ab4d-1769edc45f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:57.608051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5759bdb-b7d4-455a-ab4d-1769edc45f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:57.608325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5759bdb-b7d4-455a-ab4d-1769edc45f27 admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:57.609274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5759bdb-b7d4-455a-ab4d-1769edc45f27 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b1044bcdc94a2da05a52b6795082d0)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:32:57.611061 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5759bdb-b7d4-455a-ab4d-1769edc45f27 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:32:57.612774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 658/1318] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:32:57 2022] GET /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:32:57.638724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cc717-b13f-42d6-87d6-7ec308571bf5 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:57.639011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cc717-b13f-42d6-87d6-7ec308571bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:57.639290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cc717-b13f-42d6-87d6-7ec308571bf5 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:57.641123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 661/1319] 10.222.0.15 () {54 vars in 964 bytes} [Mon Feb 7 02:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:32:57.646716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2da8d-0c59-4336-9096-8996819e1704 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:57.646999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2da8d-0c59-4336-9096-8996819e1704 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:57.647270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2da8d-0c59-4336-9096-8996819e1704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:57.719189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-26e2da8d-0c59-4336-9096-8996819e1704 None None] MFA Rules not processed for user `b3922641f7c846da98457824bec58652`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:32:57.720412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-26e2da8d-0c59-4336-9096-8996819e1704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:57.792635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 659/1320] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Feb 7 02:32:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:32:57.801846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cc717-b13f-42d6-87d6-7ec308571bf5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:32:57.803357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4c2cc717-b13f-42d6-87d6-7ec308571bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:57.900595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cc717-b13f-42d6-87d6-7ec308571bf5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:32:57.970638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62193ce7-2082-447b-9a44-8129b591aebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:32:57.971276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62193ce7-2082-447b-9a44-8129b591aebe service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:32:57.971549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62193ce7-2082-447b-9a44-8129b591aebe service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:32:57.971817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62193ce7-2082-447b-9a44-8129b591aebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:32:57.973449 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-62193ce7-2082-447b-9a44-8129b591aebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:32:58.076975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62193ce7-2082-447b-9a44-8129b591aebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:32:58.078335 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62193ce7-2082-447b-9a44-8129b591aebe service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:32:58.096372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 662/1321] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:00.822067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39db081-70db-402d-9770-3b296c20e21f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:00.822586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39db081-70db-402d-9770-3b296c20e21f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:00.822586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39db081-70db-402d-9770-3b296c20e21f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:00.824359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 660/1322] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:00.830275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a278e-a82b-4da1-8f41-86f4c3f620b3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:00.830667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a278e-a82b-4da1-8f41-86f4c3f620b3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:00.830839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a278e-a82b-4da1-8f41-86f4c3f620b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:00.891631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b20a278e-a82b-4da1-8f41-86f4c3f620b3 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:00.892824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b20a278e-a82b-4da1-8f41-86f4c3f620b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:00.983330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 663/1323] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:01.018619 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39db081-70db-402d-9770-3b296c20e21f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:01.020166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e39db081-70db-402d-9770-3b296c20e21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:01.142859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39db081-70db-402d-9770-3b296c20e21f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:01.234797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8165f-5ed9-4c5b-8a3e-d33ad75fc255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:01.235709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8165f-5ed9-4c5b-8a3e-d33ad75fc255 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:01.235986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8165f-5ed9-4c5b-8a3e-d33ad75fc255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:01.236257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8165f-5ed9-4c5b-8a3e-d33ad75fc255 admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:01.245765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8165f-5ed9-4c5b-8a3e-d33ad75fc255 admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:01.248730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8165f-5ed9-4c5b-8a3e-d33ad75fc255 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:01.250637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 661/1324] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:33:01 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:33:01.262282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a278e-a82b-4da1-8f41-86f4c3f620b3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:01.264143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b20a278e-a82b-4da1-8f41-86f4c3f620b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:01.350242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a278e-a82b-4da1-8f41-86f4c3f620b3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:01.418959 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29270c0-059c-4c9c-8749-50a5ffb12a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:01.420061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29270c0-059c-4c9c-8749-50a5ffb12a2d service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:01.420334 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29270c0-059c-4c9c-8749-50a5ffb12a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:01.420630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29270c0-059c-4c9c-8749-50a5ffb12a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:01.422237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f29270c0-059c-4c9c-8749-50a5ffb12a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:01.529345 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29270c0-059c-4c9c-8749-50a5ffb12a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:01.533316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29270c0-059c-4c9c-8749-50a5ffb12a2d service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:01.551980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 664/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:04.257010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd4e39-be2b-448a-9619-097b36143cbe None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:04.257594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd4e39-be2b-448a-9619-097b36143cbe None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:04.257594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd4e39-be2b-448a-9619-097b36143cbe None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:04.259356 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 662/1326] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:04.265116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1d0cd-ad2b-44dd-a26e-1eaf0939ae50 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:04.265541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1d0cd-ad2b-44dd-a26e-1eaf0939ae50 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:04.265655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1d0cd-ad2b-44dd-a26e-1eaf0939ae50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:04.327754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3ba1d0cd-ad2b-44dd-a26e-1eaf0939ae50 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:04.328977 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3ba1d0cd-ad2b-44dd-a26e-1eaf0939ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:04.420228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 665/1327] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:04.453773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd4e39-be2b-448a-9619-097b36143cbe None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:04.455263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2afd4e39-be2b-448a-9619-097b36143cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:04.573446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd4e39-be2b-448a-9619-097b36143cbe None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:04.660980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7f206-1804-4283-99e2-9cde5c76ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:04.661816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f206-1804-4283-99e2-9cde5c76ff5e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:04.662088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f206-1804-4283-99e2-9cde5c76ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:04.662353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7f206-1804-4283-99e2-9cde5c76ff5e admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:04.672217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7f206-1804-4283-99e2-9cde5c76ff5e admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:04.674287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7f206-1804-4283-99e2-9cde5c76ff5e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:04.675978 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 663/1328] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:33:04 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:33:04.688133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1d0cd-ad2b-44dd-a26e-1eaf0939ae50 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:04.689365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3ba1d0cd-ad2b-44dd-a26e-1eaf0939ae50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:04.774807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1d0cd-ad2b-44dd-a26e-1eaf0939ae50 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:04.844459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de8521-caff-4921-a909-4decdae99300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:04.845030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de8521-caff-4921-a909-4decdae99300 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:04.845320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de8521-caff-4921-a909-4decdae99300 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:04.845578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de8521-caff-4921-a909-4decdae99300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:04.847175 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-92de8521-caff-4921-a909-4decdae99300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:04.948866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de8521-caff-4921-a909-4decdae99300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:04.950587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de8521-caff-4921-a909-4decdae99300 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:04.968086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 666/1329] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:07.809144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626ccaa-9fc5-4dac-9996-87e0a73022c8 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:07.810230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626ccaa-9fc5-4dac-9996-87e0a73022c8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:07.810230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626ccaa-9fc5-4dac-9996-87e0a73022c8 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:07.812191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 664/1330] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:07.817165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1094b9-d026-445c-b988-1bd637b3e47b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:07.817581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1094b9-d026-445c-b988-1bd637b3e47b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:07.817715 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1094b9-d026-445c-b988-1bd637b3e47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:07.881553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1b1094b9-d026-445c-b988-1bd637b3e47b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:07.882737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1b1094b9-d026-445c-b988-1bd637b3e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:07.981038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 667/1331] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:08.017009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626ccaa-9fc5-4dac-9996-87e0a73022c8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:08.018527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8626ccaa-9fc5-4dac-9996-87e0a73022c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:08.121070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626ccaa-9fc5-4dac-9996-87e0a73022c8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:08.191836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76304a-43fe-491e-9ca3-73ded572169c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:08.192518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76304a-43fe-491e-9ca3-73ded572169c service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:08.192807 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76304a-43fe-491e-9ca3-73ded572169c service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:08.193082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76304a-43fe-491e-9ca3-73ded572169c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:08.194701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0f76304a-43fe-491e-9ca3-73ded572169c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:08.302471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76304a-43fe-491e-9ca3-73ded572169c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:08.303815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76304a-43fe-491e-9ca3-73ded572169c service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:08.321185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 665/1332] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:10.588886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de0cc9-eed8-4088-b4a3-517dff3442a3 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:10.589425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de0cc9-eed8-4088-b4a3-517dff3442a3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:10.589425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de0cc9-eed8-4088-b4a3-517dff3442a3 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:10.591234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 668/1333] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:10.596711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44451-e136-4e03-b5c1-40c1eef645e3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:10.597195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44451-e136-4e03-b5c1-40c1eef645e3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:10.597298 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44451-e136-4e03-b5c1-40c1eef645e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:10.663428 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-17d44451-e136-4e03-b5c1-40c1eef645e3 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:10.664662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-17d44451-e136-4e03-b5c1-40c1eef645e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:10.758506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 666/1334] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:10.794742 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de0cc9-eed8-4088-b4a3-517dff3442a3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:10.796392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c0de0cc9-eed8-4088-b4a3-517dff3442a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:10.895614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de0cc9-eed8-4088-b4a3-517dff3442a3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:10.965709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf70a58-5efc-4d31-812d-0658f5abad10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:10.966371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf70a58-5efc-4d31-812d-0658f5abad10 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:10.966648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf70a58-5efc-4d31-812d-0658f5abad10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:10.966920 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf70a58-5efc-4d31-812d-0658f5abad10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:10.968579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8bf70a58-5efc-4d31-812d-0658f5abad10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:11.075286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf70a58-5efc-4d31-812d-0658f5abad10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:11.076672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf70a58-5efc-4d31-812d-0658f5abad10 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:11.095306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 669/1335] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:13.358816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713a5da-a02c-4290-bbe3-27ad960a99b1 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:13.359458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713a5da-a02c-4290-bbe3-27ad960a99b1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:13.359458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713a5da-a02c-4290-bbe3-27ad960a99b1 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:13.361195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 667/1336] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:13.366407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c305e-cd0a-4c6b-b4f5-26f34b99e923 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:13.366838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c305e-cd0a-4c6b-b4f5-26f34b99e923 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:13.366950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c305e-cd0a-4c6b-b4f5-26f34b99e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:13.430135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bd0c305e-cd0a-4c6b-b4f5-26f34b99e923 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:13.431333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bd0c305e-cd0a-4c6b-b4f5-26f34b99e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:13.524497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 670/1337] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:13.559387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713a5da-a02c-4290-bbe3-27ad960a99b1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:13.562114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5713a5da-a02c-4290-bbe3-27ad960a99b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:13.685453 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713a5da-a02c-4290-bbe3-27ad960a99b1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:13.775264 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1ea7b-0cab-42ac-9827-cb6e07440e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:13.776111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1ea7b-0cab-42ac-9827-cb6e07440e4a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:13.776415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1ea7b-0cab-42ac-9827-cb6e07440e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:13.776688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1ea7b-0cab-42ac-9827-cb6e07440e4a admin admin] PATH_INFO: `/v3/projects/26c9bf6ae4fc41448605f4cdce111a09` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:13.786874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1ea7b-0cab-42ac-9827-cb6e07440e4a admin admin] RBAC: Authorizing `identity:get_project(project_id=26c9bf6ae4fc41448605f4cdce111a09)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:13.788982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1ea7b-0cab-42ac-9827-cb6e07440e4a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:13.790715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 668/1338] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:33:13 2022] GET /identity/v3/projects/26c9bf6ae4fc41448605f4cdce111a09 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:33:13.802036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c305e-cd0a-4c6b-b4f5-26f34b99e923 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:13.803233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bd0c305e-cd0a-4c6b-b4f5-26f34b99e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:13.889972 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c305e-cd0a-4c6b-b4f5-26f34b99e923 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:13.960183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32728982-f973-484c-b7b2-3dcb1ea690a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:13.960789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728982-f973-484c-b7b2-3dcb1ea690a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:13.961067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728982-f973-484c-b7b2-3dcb1ea690a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:13.961340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728982-f973-484c-b7b2-3dcb1ea690a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:13.962965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-32728982-f973-484c-b7b2-3dcb1ea690a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:14.067214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32728982-f973-484c-b7b2-3dcb1ea690a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:14.068696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32728982-f973-484c-b7b2-3dcb1ea690a5 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:14.086874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 671/1339] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:16.529618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946d49-ada8-4196-b3f7-e41ca9f97d93 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:16.530149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946d49-ada8-4196-b3f7-e41ca9f97d93 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:16.530149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946d49-ada8-4196-b3f7-e41ca9f97d93 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:16.532092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 669/1340] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:16.537204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5adf7-712e-48f3-b043-8d75415d3d31 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:16.537620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5adf7-712e-48f3-b043-8d75415d3d31 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:16.537757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5adf7-712e-48f3-b043-8d75415d3d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:16.608876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3aa5adf7-712e-48f3-b043-8d75415d3d31 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:16.610106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3aa5adf7-712e-48f3-b043-8d75415d3d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:16.720384 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 672/1341] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:16.756196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946d49-ada8-4196-b3f7-e41ca9f97d93 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:16.757793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ea946d49-ada8-4196-b3f7-e41ca9f97d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:16.869750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946d49-ada8-4196-b3f7-e41ca9f97d93 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:16.942332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffed2ef-7863-4069-b578-9d6340f8028d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:16.943325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffed2ef-7863-4069-b578-9d6340f8028d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:16.943819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffed2ef-7863-4069-b578-9d6340f8028d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:16.944154 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffed2ef-7863-4069-b578-9d6340f8028d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:16.945834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2ffed2ef-7863-4069-b578-9d6340f8028d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:17.061192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffed2ef-7863-4069-b578-9d6340f8028d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:17.062761 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffed2ef-7863-4069-b578-9d6340f8028d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:17.081302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 670/1342] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:19.332873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ef12f-9979-4115-bb32-f947f0b4855c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:19.333431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ef12f-9979-4115-bb32-f947f0b4855c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:19.333431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ef12f-9979-4115-bb32-f947f0b4855c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:19.335239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 673/1343] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:19.340294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129284a3-4e59-4177-98ac-92175d2c41ed None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:19.340826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129284a3-4e59-4177-98ac-92175d2c41ed None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:19.340923 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129284a3-4e59-4177-98ac-92175d2c41ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:19.410047 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-129284a3-4e59-4177-98ac-92175d2c41ed None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:19.411250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-129284a3-4e59-4177-98ac-92175d2c41ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:19.511251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 671/1344] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:19.546114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ef12f-9979-4115-bb32-f947f0b4855c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:19.559942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ef12f-9979-4115-bb32-f947f0b4855c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:19.565985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48712b9-f145-4477-954f-fdc3e2b6eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:19.567277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48712b9-f145-4477-954f-fdc3e2b6eae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:19.567775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48712b9-f145-4477-954f-fdc3e2b6eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:19.568101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48712b9-f145-4477-954f-fdc3e2b6eae9 admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:19.569350 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48712b9-f145-4477-954f-fdc3e2b6eae9 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b1044bcdc94a2da05a52b6795082d0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:19.571131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48712b9-f145-4477-954f-fdc3e2b6eae9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:19.572824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 674/1345] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:33:19 2022] GET /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:33:19.584623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129284a3-4e59-4177-98ac-92175d2c41ed None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:19.585974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-129284a3-4e59-4177-98ac-92175d2c41ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:19.677548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129284a3-4e59-4177-98ac-92175d2c41ed None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:19.681253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480a1bd-30ac-444c-9c08-89d5e9c2d82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:19.681888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a1bd-30ac-444c-9c08-89d5e9c2d82e service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:19.682166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a1bd-30ac-444c-9c08-89d5e9c2d82e service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:19.682438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480a1bd-30ac-444c-9c08-89d5e9c2d82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:19.692103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480a1bd-30ac-444c-9c08-89d5e9c2d82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:19.693567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480a1bd-30ac-444c-9c08-89d5e9c2d82e service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:19.702906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 672/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:22.188563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90146a-a2f9-42e3-9ed6-2ca7bee679a1 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:22.189080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90146a-a2f9-42e3-9ed6-2ca7bee679a1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:22.189080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90146a-a2f9-42e3-9ed6-2ca7bee679a1 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:22.190856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 675/1347] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:22.196165 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def5e96-a782-4869-b3f9-263b6854f47c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:22.196597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def5e96-a782-4869-b3f9-263b6854f47c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:22.196751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def5e96-a782-4869-b3f9-263b6854f47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:22.214461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5def5e96-a782-4869-b3f9-263b6854f47c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:22.216162 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5def5e96-a782-4869-b3f9-263b6854f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:22.223833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 673/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:22.259813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90146a-a2f9-42e3-9ed6-2ca7bee679a1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:22.270147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90146a-a2f9-42e3-9ed6-2ca7bee679a1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:22.273592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1ead4-0bc2-430b-ad0e-eb3679670dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:22.274212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ead4-0bc2-430b-ad0e-eb3679670dfa service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:22.274486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ead4-0bc2-430b-ad0e-eb3679670dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:22.274753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ead4-0bc2-430b-ad0e-eb3679670dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:22.283760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1ead4-0bc2-430b-ad0e-eb3679670dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:22.285203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1ead4-0bc2-430b-ad0e-eb3679670dfa service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:22.294747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 676/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:26.351514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355788c-d321-45cc-a19c-cdb900fc788a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:26.352023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355788c-d321-45cc-a19c-cdb900fc788a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:26.352023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355788c-d321-45cc-a19c-cdb900fc788a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:26.353952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 674/1350] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:26.359268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991eb7f-87b0-4be3-8715-fba97009e5f0 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:26.359709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991eb7f-87b0-4be3-8715-fba97009e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:26.359930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991eb7f-87b0-4be3-8715-fba97009e5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:26.378410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c991eb7f-87b0-4be3-8715-fba97009e5f0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:26.379606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c991eb7f-87b0-4be3-8715-fba97009e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:26.388055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 677/1351] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:26.410987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355788c-d321-45cc-a19c-cdb900fc788a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:26.423058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355788c-d321-45cc-a19c-cdb900fc788a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:26.427462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cd5c9-e08b-4dcf-8473-8b301ed0d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:26.428098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cd5c9-e08b-4dcf-8473-8b301ed0d6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:26.428459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cd5c9-e08b-4dcf-8473-8b301ed0d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:26.428767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cd5c9-e08b-4dcf-8473-8b301ed0d6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:26.429503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cd5c9-e08b-4dcf-8473-8b301ed0d6c9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:26.431338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cd5c9-e08b-4dcf-8473-8b301ed0d6c9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:26.444797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 675/1352] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:33:26 2022] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:33:28.666900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10c8b-123b-4898-b3ee-f914948e8a03 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:28.667445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10c8b-123b-4898-b3ee-f914948e8a03 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:28.667445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de10c8b-123b-4898-b3ee-f914948e8a03 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:28.669938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 678/1353] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:28.675098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d80d9-0d32-4071-968c-a2ebef5998a7 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:28.675865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d80d9-0d32-4071-968c-a2ebef5998a7 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:28.676143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d80d9-0d32-4071-968c-a2ebef5998a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:28.694376 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e87d80d9-0d32-4071-968c-a2ebef5998a7 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:28.695537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e87d80d9-0d32-4071-968c-a2ebef5998a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:28.703510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 676/1354] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:28.736835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de10c8b-123b-4898-b3ee-f914948e8a03 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:28.749488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de10c8b-123b-4898-b3ee-f914948e8a03 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:28.753820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b989a4-2c15-499b-981e-9793516cec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:28.754636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b989a4-2c15-499b-981e-9793516cec41 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:28.754911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b989a4-2c15-499b-981e-9793516cec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:28.755180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b989a4-2c15-499b-981e-9793516cec41 admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:28.756394 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b989a4-2c15-499b-981e-9793516cec41 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b1044bcdc94a2da05a52b6795082d0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:28.758178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b989a4-2c15-499b-981e-9793516cec41 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:28.759817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 679/1355] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:33:28 2022] GET /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:33:28.771056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d80d9-0d32-4071-968c-a2ebef5998a7 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:28.772423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e87d80d9-0d32-4071-968c-a2ebef5998a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:28.783835 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d80d9-0d32-4071-968c-a2ebef5998a7 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:28.787326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b66c72-b9b7-49d0-898e-c7789e75e03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:28.787958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b66c72-b9b7-49d0-898e-c7789e75e03d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:28.788234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b66c72-b9b7-49d0-898e-c7789e75e03d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:28.788544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b66c72-b9b7-49d0-898e-c7789e75e03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:28.797895 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b66c72-b9b7-49d0-898e-c7789e75e03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:28.799300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b66c72-b9b7-49d0-898e-c7789e75e03d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:28.808511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 677/1356] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:31.964677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f44fc-045d-421b-997d-8778f65c017b None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:31.965680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f44fc-045d-421b-997d-8778f65c017b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:31.965680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f44fc-045d-421b-997d-8778f65c017b None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:31.967426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 680/1357] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:31.972591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3607dd-720d-4c7b-b092-6ead2c58d861 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:31.973008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3607dd-720d-4c7b-b092-6ead2c58d861 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:31.973152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3607dd-720d-4c7b-b092-6ead2c58d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:31.991457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2e3607dd-720d-4c7b-b092-6ead2c58d861 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:31.992671 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2e3607dd-720d-4c7b-b092-6ead2c58d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:32.000517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 678/1358] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:32.037620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f44fc-045d-421b-997d-8778f65c017b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:32.049591 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f44fc-045d-421b-997d-8778f65c017b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:32.053957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d736c-733d-448e-b740-464f0ed397e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:32.054601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d736c-733d-448e-b740-464f0ed397e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:32.054866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d736c-733d-448e-b740-464f0ed397e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:32.055155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d736c-733d-448e-b740-464f0ed397e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:32.067022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d736c-733d-448e-b740-464f0ed397e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:32.068539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d736c-733d-448e-b740-464f0ed397e9 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:32.078913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 681/1359] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:36.507960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45c24f-7f08-49c0-aa05-f1da4b607c0f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:36.508518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45c24f-7f08-49c0-aa05-f1da4b607c0f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:36.508518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45c24f-7f08-49c0-aa05-f1da4b607c0f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:36.510333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 679/1360] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:36.516516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b960ae-af0f-42eb-967e-b16c4bfcd183 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:36.516961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b960ae-af0f-42eb-967e-b16c4bfcd183 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:36.517061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b960ae-af0f-42eb-967e-b16c4bfcd183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:36.535592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-15b960ae-af0f-42eb-967e-b16c4bfcd183 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:36.537124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-15b960ae-af0f-42eb-967e-b16c4bfcd183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:36.549155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 682/1361] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:36.589812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45c24f-7f08-49c0-aa05-f1da4b607c0f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:36.601932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45c24f-7f08-49c0-aa05-f1da4b607c0f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:36.605919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e573a-11f9-405d-a916-aba1ef2420a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:36.606580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e573a-11f9-405d-a916-aba1ef2420a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:36.606857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e573a-11f9-405d-a916-aba1ef2420a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:36.607127 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e573a-11f9-405d-a916-aba1ef2420a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:36.618535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e573a-11f9-405d-a916-aba1ef2420a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:36.620021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e573a-11f9-405d-a916-aba1ef2420a4 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:36.631128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 680/1362] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:41.570296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b8722-9ebf-41ad-8f93-c6f73a12fad1 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:41.571378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b8722-9ebf-41ad-8f93-c6f73a12fad1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:41.571876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b8722-9ebf-41ad-8f93-c6f73a12fad1 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:41.574607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 683/1363] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:33:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:41.580435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0d78-3b9c-4d09-9f23-9446b6412522 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:41.581403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0d78-3b9c-4d09-9f23-9446b6412522 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:41.584805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0d78-3b9c-4d09-9f23-9446b6412522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:41.670310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2c5e0d78-3b9c-4d09-9f23-9446b6412522 None None] MFA Rules not processed for user `b06b37b8f23946ebbb5083a877274ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:41.677251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2c5e0d78-3b9c-4d09-9f23-9446b6412522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:41.762437 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 681/1364] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:33:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:45.840704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faf29e-fa89-4efd-9982-8f554c153151 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:45.841297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faf29e-fa89-4efd-9982-8f554c153151 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:45.841297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faf29e-fa89-4efd-9982-8f554c153151 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:45.842990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 684/1365] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:45.848286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03782225-f774-470e-b3cc-ec1db2a74cf1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:45.849116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03782225-f774-470e-b3cc-ec1db2a74cf1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:45.849400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03782225-f774-470e-b3cc-ec1db2a74cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:45.868088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-03782225-f774-470e-b3cc-ec1db2a74cf1 None None] MFA Rules not processed for user `b06b37b8f23946ebbb5083a877274ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:45.869317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-03782225-f774-470e-b3cc-ec1db2a74cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:45.878520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 682/1366] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:33:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:47.506748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4216d9-f083-4f21-8509-f98400459fff None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:47.507341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4216d9-f083-4f21-8509-f98400459fff None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:47.507341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4216d9-f083-4f21-8509-f98400459fff None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:47.509484 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 685/1367] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:47.514514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7c05-4588-4244-b591-5fad32e690f1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:47.514926 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7c05-4588-4244-b591-5fad32e690f1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:47.515054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7c05-4588-4244-b591-5fad32e690f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:47.534045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bd9a7c05-4588-4244-b591-5fad32e690f1 None None] MFA Rules not processed for user `b06b37b8f23946ebbb5083a877274ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:47.535207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bd9a7c05-4588-4244-b591-5fad32e690f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:47.544580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 683/1368] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:33:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:33:51.291235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d54ee-a4fc-4f73-9bbd-2e28a19de456 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:51.291761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d54ee-a4fc-4f73-9bbd-2e28a19de456 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:51.291761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d54ee-a4fc-4f73-9bbd-2e28a19de456 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:51.293718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 686/1369] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:51.298710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de5b44-8ffb-4ff3-b89b-135bbeb85b9e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:51.299471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de5b44-8ffb-4ff3-b89b-135bbeb85b9e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:51.299752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de5b44-8ffb-4ff3-b89b-135bbeb85b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:51.318025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-60de5b44-8ffb-4ff3-b89b-135bbeb85b9e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:51.319209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-60de5b44-8ffb-4ff3-b89b-135bbeb85b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:51.327810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 684/1370] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:51.375889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22012abd-46f5-4010-a428-6e1e935dff34 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:51.376284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22012abd-46f5-4010-a428-6e1e935dff34 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:51.376684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22012abd-46f5-4010-a428-6e1e935dff34 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:51.378566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 687/1371] 10.222.0.15 () {54 vars in 961 bytes} [Mon Feb 7 02:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:51.383782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f350b8-e459-4664-858f-25e10413b033 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:51.384182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f350b8-e459-4664-858f-25e10413b033 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:51.384689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f350b8-e459-4664-858f-25e10413b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:51.444070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-09f350b8-e459-4664-858f-25e10413b033 None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:51.445516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-09f350b8-e459-4664-858f-25e10413b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:51.533121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 685/1372] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Feb 7 02:33:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:33:51.541104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22012abd-46f5-4010-a428-6e1e935dff34 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:51.555479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22012abd-46f5-4010-a428-6e1e935dff34 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:51.561402 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef267f72-a559-4128-8998-560fcb4e2cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:51.562034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef267f72-a559-4128-8998-560fcb4e2cd8 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:51.562309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef267f72-a559-4128-8998-560fcb4e2cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:51.562587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef267f72-a559-4128-8998-560fcb4e2cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:51.570901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef267f72-a559-4128-8998-560fcb4e2cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:51.572501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef267f72-a559-4128-8998-560fcb4e2cd8 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:51.583212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 688/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:33:54.025076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb479953-4233-4c2f-b32e-5eaf4d5256fe None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:54.025569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb479953-4233-4c2f-b32e-5eaf4d5256fe None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:54.025569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb479953-4233-4c2f-b32e-5eaf4d5256fe None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:54.027535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 686/1374] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:54.032607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b16edb-658b-4d51-be9a-0a219ae2f7ed None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:54.033027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b16edb-658b-4d51-be9a-0a219ae2f7ed None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:54.033144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b16edb-658b-4d51-be9a-0a219ae2f7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:54.052044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e0b16edb-658b-4d51-be9a-0a219ae2f7ed None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:54.053254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e0b16edb-658b-4d51-be9a-0a219ae2f7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:54.065192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 689/1375] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:54.109302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb479953-4233-4c2f-b32e-5eaf4d5256fe None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:54.124049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb479953-4233-4c2f-b32e-5eaf4d5256fe None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:54.129781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b872b1-ba2e-4ebd-b400-26953eecc2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:54.130536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b872b1-ba2e-4ebd-b400-26953eecc2b0 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:54.130883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b872b1-ba2e-4ebd-b400-26953eecc2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:54.131226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b872b1-ba2e-4ebd-b400-26953eecc2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:54.140567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b872b1-ba2e-4ebd-b400-26953eecc2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:54.142696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b872b1-ba2e-4ebd-b400-26953eecc2b0 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:54.154016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 687/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:56.705566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082eb7e-4453-47ad-aba3-9362cd695b80 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:56.706041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082eb7e-4453-47ad-aba3-9362cd695b80 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:56.706198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082eb7e-4453-47ad-aba3-9362cd695b80 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:56.708003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 690/1377] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:56.713503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8497ba-704b-4653-a0d0-cd0c7e50ad21 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:56.713903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8497ba-704b-4653-a0d0-cd0c7e50ad21 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:56.714199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8497ba-704b-4653-a0d0-cd0c7e50ad21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:56.731820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3b8497ba-704b-4653-a0d0-cd0c7e50ad21 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:56.733029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3b8497ba-704b-4653-a0d0-cd0c7e50ad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:56.740746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 688/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:56.785508 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb022e28-e156-41f4-82ea-256632cfd237 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:56.785792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb022e28-e156-41f4-82ea-256632cfd237 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:56.786065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb022e28-e156-41f4-82ea-256632cfd237 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:56.787825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 691/1379] 10.222.0.15 () {54 vars in 961 bytes} [Mon Feb 7 02:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:56.793055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ed070-8f54-4805-a4ac-d2e93b2db8b0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:56.793340 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ed070-8f54-4805-a4ac-d2e93b2db8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:56.793618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ed070-8f54-4805-a4ac-d2e93b2db8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:56.811862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ac8ed070-8f54-4805-a4ac-d2e93b2db8b0 None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:56.813067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ac8ed070-8f54-4805-a4ac-d2e93b2db8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:56.822166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 689/1380] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Feb 7 02:33:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:33:56.830466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb022e28-e156-41f4-82ea-256632cfd237 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:56.844369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb022e28-e156-41f4-82ea-256632cfd237 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:56.850148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ee27c-f110-4113-9b98-ff40e7407ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:56.850967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ee27c-f110-4113-9b98-ff40e7407ed2 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:56.851384 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ee27c-f110-4113-9b98-ff40e7407ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:56.851898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ee27c-f110-4113-9b98-ff40e7407ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:56.861234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ee27c-f110-4113-9b98-ff40e7407ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:56.862827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ee27c-f110-4113-9b98-ff40e7407ed2 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:56.872723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 692/1381] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:59.156431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cd231-8ce9-4c11-b563-6c0dbfd3c527 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:59.156986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cd231-8ce9-4c11-b563-6c0dbfd3c527 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:59.156986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cd231-8ce9-4c11-b563-6c0dbfd3c527 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:59.158764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 690/1382] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:59.164011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de7329-0e98-4ace-baaf-d729defede3a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:59.164493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de7329-0e98-4ace-baaf-d729defede3a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:59.164575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de7329-0e98-4ace-baaf-d729defede3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:59.182816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b3de7329-0e98-4ace-baaf-d729defede3a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:59.183991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b3de7329-0e98-4ace-baaf-d729defede3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:59.191829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 693/1383] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:59.236771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cd231-8ce9-4c11-b563-6c0dbfd3c527 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:59.251155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cd231-8ce9-4c11-b563-6c0dbfd3c527 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:59.256534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e612f-83e1-4547-80e5-8fcd867c87bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:59.257177 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e612f-83e1-4547-80e5-8fcd867c87bf service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:59.257457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e612f-83e1-4547-80e5-8fcd867c87bf service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:59.257935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e612f-83e1-4547-80e5-8fcd867c87bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:59.267043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e612f-83e1-4547-80e5-8fcd867c87bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:59.268698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e612f-83e1-4547-80e5-8fcd867c87bf service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:59.279294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 691/1384] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:33:59.326258 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af004470-0714-4751-8562-b160abbdd1fd None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:59.326547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af004470-0714-4751-8562-b160abbdd1fd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:59.327003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af004470-0714-4751-8562-b160abbdd1fd None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:59.328896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 694/1385] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:59.334919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e0181-68d6-4a5b-b885-6427f1cdebc4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:59.335259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e0181-68d6-4a5b-b885-6427f1cdebc4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:59.335539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e0181-68d6-4a5b-b885-6427f1cdebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:59.355526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-311e0181-68d6-4a5b-b885-6427f1cdebc4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:59.356753 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-311e0181-68d6-4a5b-b885-6427f1cdebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:59.365037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 692/1386] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:59.632735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651a0f8-f801-4aa3-879a-1cd872f06134 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:59.632931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651a0f8-f801-4aa3-879a-1cd872f06134 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:59.633371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651a0f8-f801-4aa3-879a-1cd872f06134 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:59.635302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 695/1387] 10.222.0.15 () {54 vars in 963 bytes} [Mon Feb 7 02:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:33:59.640790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c7264-7c8d-4d0d-b788-393639154677 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:59.641174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c7264-7c8d-4d0d-b788-393639154677 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:59.641514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c7264-7c8d-4d0d-b788-393639154677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:59.691572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5c5c7264-7c8d-4d0d-b788-393639154677 None None] MFA Rules not processed for user `2e738156764e4b038adc89cf114ccda3`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:33:59.692787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5c5c7264-7c8d-4d0d-b788-393639154677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:33:59.753451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 693/1388] 10.222.0.15 () {58 vars in 1060 bytes} [Mon Feb 7 02:33:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:33:59.771415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651a0f8-f801-4aa3-879a-1cd872f06134 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:33:59.782396 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651a0f8-f801-4aa3-879a-1cd872f06134 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:33:59.785985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fbe56-f875-4952-9f58-8734b2700164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:33:59.786704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbe56-f875-4952-9f58-8734b2700164 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:33:59.787269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbe56-f875-4952-9f58-8734b2700164 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:33:59.787614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbe56-f875-4952-9f58-8734b2700164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:33:59.796752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fbe56-f875-4952-9f58-8734b2700164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:33:59.798401 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fbe56-f875-4952-9f58-8734b2700164 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:33:59.811238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 696/1389] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:01.562022 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923f010-475a-4390-9d6d-4d0f0d23723a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:01.562521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923f010-475a-4390-9d6d-4d0f0d23723a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:01.562691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923f010-475a-4390-9d6d-4d0f0d23723a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:01.564693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 694/1390] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:01.570095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0296-d1cf-4c4f-9220-cfe820b2d774 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:01.570550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0296-d1cf-4c4f-9220-cfe820b2d774 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:01.570647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0296-d1cf-4c4f-9220-cfe820b2d774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:01.590427 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3faf0296-d1cf-4c4f-9220-cfe820b2d774 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:01.591623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3faf0296-d1cf-4c4f-9220-cfe820b2d774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:01.599557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 697/1391] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:01.648810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923f010-475a-4390-9d6d-4d0f0d23723a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:01.663036 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923f010-475a-4390-9d6d-4d0f0d23723a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:01.670075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2261368e-53b8-45b3-bcdd-91e8c430106f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:01.670733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261368e-53b8-45b3-bcdd-91e8c430106f service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:01.671024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261368e-53b8-45b3-bcdd-91e8c430106f service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:01.671309 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261368e-53b8-45b3-bcdd-91e8c430106f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:01.680262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261368e-53b8-45b3-bcdd-91e8c430106f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:01.681919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2261368e-53b8-45b3-bcdd-91e8c430106f service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:01.692374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 695/1392] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:03.993329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ffb32-a6a0-4228-b155-319bb1d5b866 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:03.994228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ffb32-a6a0-4228-b155-319bb1d5b866 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:03.994578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ffb32-a6a0-4228-b155-319bb1d5b866 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:03.996493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 698/1393] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:04.001871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b53fc-1c76-4d86-be56-eaaf205899d9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:04.002311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b53fc-1c76-4d86-be56-eaaf205899d9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:04.002431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b53fc-1c76-4d86-be56-eaaf205899d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:04.020988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a29b53fc-1c76-4d86-be56-eaaf205899d9 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:04.022395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a29b53fc-1c76-4d86-be56-eaaf205899d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:04.031297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 696/1394] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:04.078552 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ffb32-a6a0-4228-b155-319bb1d5b866 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:04.093188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ffb32-a6a0-4228-b155-319bb1d5b866 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:04.098663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131712-64d5-4b8f-9613-6704f4847070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:04.099304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131712-64d5-4b8f-9613-6704f4847070 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:04.099584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131712-64d5-4b8f-9613-6704f4847070 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:04.099859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131712-64d5-4b8f-9613-6704f4847070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:04.108320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b131712-64d5-4b8f-9613-6704f4847070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:04.109927 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b131712-64d5-4b8f-9613-6704f4847070 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:04.120723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 699/1395] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:06.370490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c86ae-8658-45f6-b9b6-fd5dd96a41f3 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:06.371027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c86ae-8658-45f6-b9b6-fd5dd96a41f3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:06.371027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c86ae-8658-45f6-b9b6-fd5dd96a41f3 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:06.372880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 697/1396] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:06.378170 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c857e-1486-4107-9219-cb724db21e81 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:06.378580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c857e-1486-4107-9219-cb724db21e81 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:06.378724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c857e-1486-4107-9219-cb724db21e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:06.396925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c08c857e-1486-4107-9219-cb724db21e81 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:06.398340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c08c857e-1486-4107-9219-cb724db21e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:06.406734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 700/1397] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:06.448478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c86ae-8658-45f6-b9b6-fd5dd96a41f3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:06.464296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c86ae-8658-45f6-b9b6-fd5dd96a41f3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:06.470242 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba96a-6a55-4931-9d49-c6efef1d42c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:06.471037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba96a-6a55-4931-9d49-c6efef1d42c2 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:06.471422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba96a-6a55-4931-9d49-c6efef1d42c2 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:06.471796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba96a-6a55-4931-9d49-c6efef1d42c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:06.482079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba96a-6a55-4931-9d49-c6efef1d42c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:06.484026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba96a-6a55-4931-9d49-c6efef1d42c2 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:06.495504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 698/1398] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:10.006934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858f085-6423-4038-b428-94b1a5d01891 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:10.007450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858f085-6423-4038-b428-94b1a5d01891 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:10.007450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858f085-6423-4038-b428-94b1a5d01891 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:10.009314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 701/1399] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:10.016068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7066a-7755-4e89-8900-de1730626d8c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:10.016685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7066a-7755-4e89-8900-de1730626d8c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:10.017172 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7066a-7755-4e89-8900-de1730626d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:10.049375 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-09a7066a-7755-4e89-8900-de1730626d8c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:10.051598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-09a7066a-7755-4e89-8900-de1730626d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:10.066840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 699/1400] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:10.111987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858f085-6423-4038-b428-94b1a5d01891 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:10.126200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858f085-6423-4038-b428-94b1a5d01891 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:10.131822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696f1e0-202b-4c00-9f10-82024b72636c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:10.132481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696f1e0-202b-4c00-9f10-82024b72636c service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:10.132765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696f1e0-202b-4c00-9f10-82024b72636c service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:10.133038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696f1e0-202b-4c00-9f10-82024b72636c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:10.143445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696f1e0-202b-4c00-9f10-82024b72636c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:10.146623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696f1e0-202b-4c00-9f10-82024b72636c service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:10.165190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 702/1401] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:12.423050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4eb2b-b4d1-4071-8003-1b8268bd9e0b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:12.424649 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4eb2b-b4d1-4071-8003-1b8268bd9e0b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:12.425392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4eb2b-b4d1-4071-8003-1b8268bd9e0b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:12.429204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 700/1402] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:34:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:12.435492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6370c-5cc6-4c38-b309-eae2f257d8af None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:12.435997 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6370c-5cc6-4c38-b309-eae2f257d8af None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:12.436100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6370c-5cc6-4c38-b309-eae2f257d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:12.456310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-88f6370c-5cc6-4c38-b309-eae2f257d8af None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:12.457644 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-88f6370c-5cc6-4c38-b309-eae2f257d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:12.466058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 703/1403] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:12.513544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4eb2b-b4d1-4071-8003-1b8268bd9e0b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:12.528145 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4eb2b-b4d1-4071-8003-1b8268bd9e0b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:12.533485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e818616-b8b8-4743-ab32-81658bae93e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:12.534116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e818616-b8b8-4743-ab32-81658bae93e6 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:12.534395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e818616-b8b8-4743-ab32-81658bae93e6 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:12.534665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e818616-b8b8-4743-ab32-81658bae93e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:12.543484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e818616-b8b8-4743-ab32-81658bae93e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:12.545124 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e818616-b8b8-4743-ab32-81658bae93e6 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:12.554670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 701/1404] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:34:14.805756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643874f-ce3e-4769-a11c-222c8e00923d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:14.806309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643874f-ce3e-4769-a11c-222c8e00923d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:14.806309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643874f-ce3e-4769-a11c-222c8e00923d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:14.808600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 704/1405] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:14.813832 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c853f96-9be5-47e2-8031-4f762e741e03 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:14.814276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c853f96-9be5-47e2-8031-4f762e741e03 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:14.814384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c853f96-9be5-47e2-8031-4f762e741e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:14.832697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9c853f96-9be5-47e2-8031-4f762e741e03 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:14.833870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9c853f96-9be5-47e2-8031-4f762e741e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:14.838286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bab30-4272-499e-8124-fcc0481c360e None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:14.838608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bab30-4272-499e-8124-fcc0481c360e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:14.838889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bab30-4272-499e-8124-fcc0481c360e None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:14.840831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 705/1406] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:34:14.841799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 702/1407] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:14.845369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e347-9083-4825-b10a-662993d85da2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:14.845654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e347-9083-4825-b10a-662993d85da2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:14.845924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9e347-9083-4825-b10a-662993d85da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:14.863532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1cf9e347-9083-4825-b10a-662993d85da2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:14.864736 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1cf9e347-9083-4825-b10a-662993d85da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:14.873266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 706/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:14.884892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c853f96-9be5-47e2-8031-4f762e741e03 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:14.897343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c853f96-9be5-47e2-8031-4f762e741e03 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:14.902754 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3df1c0-c92f-4707-84f8-d33f6aa37a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:14.903382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3df1c0-c92f-4707-84f8-d33f6aa37a44 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:14.903659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3df1c0-c92f-4707-84f8-d33f6aa37a44 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:14.903932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3df1c0-c92f-4707-84f8-d33f6aa37a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:14.912156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3df1c0-c92f-4707-84f8-d33f6aa37a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:14.913762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3df1c0-c92f-4707-84f8-d33f6aa37a44 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:14.924140 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 703/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:14.928016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db492702-d05c-4769-96bd-2b732fb9d75c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:14.928303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db492702-d05c-4769-96bd-2b732fb9d75c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:14.928614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db492702-d05c-4769-96bd-2b732fb9d75c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:14.930407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 707/1410] 10.222.0.15 () {54 vars in 962 bytes} [Mon Feb 7 02:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:14.936146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a87bc-dde2-485c-b4fb-acebfd714377 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:14.936536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a87bc-dde2-485c-b4fb-acebfd714377 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:14.936750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a87bc-dde2-485c-b4fb-acebfd714377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:14.995943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-748a87bc-dde2-485c-b4fb-acebfd714377 None None] MFA Rules not processed for user `612a02fb42af490abcba0e75ec8c759f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:14.995943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-748a87bc-dde2-485c-b4fb-acebfd714377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:15.050149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 704/1411] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Feb 7 02:34:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:34:15.058757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db492702-d05c-4769-96bd-2b732fb9d75c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:15.070887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db492702-d05c-4769-96bd-2b732fb9d75c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:15.075677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968f30e-5291-443e-a7a7-fd85fa67da13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '612a02fb42af490abcba0e75ec8c759f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:15.076664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968f30e-5291-443e-a7a7-fd85fa67da13 service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:15.076943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968f30e-5291-443e-a7a7-fd85fa67da13 service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:15.077218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968f30e-5291-443e-a7a7-fd85fa67da13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:15.087395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968f30e-5291-443e-a7a7-fd85fa67da13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:15.088979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968f30e-5291-443e-a7a7-fd85fa67da13 service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:15.099325 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 708/1412] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:34:15.510570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945955-8a88-47b1-ac35-b1e50ca458cf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:15.510859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945955-8a88-47b1-ac35-b1e50ca458cf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:15.511138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945955-8a88-47b1-ac35-b1e50ca458cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:15.557707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-74945955-8a88-47b1-ac35-b1e50ca458cf None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:15.558891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-74945955-8a88-47b1-ac35-b1e50ca458cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:15.621448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 705/1413] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:15.665137 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa198ec6-5404-4872-bc56-dbf2b7ccf715 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:15.665494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa198ec6-5404-4872-bc56-dbf2b7ccf715 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:15.665858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa198ec6-5404-4872-bc56-dbf2b7ccf715 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:15.668362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 709/1414] 10.222.0.15 () {54 vars in 942 bytes} [Mon Feb 7 02:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:15.674633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f599-0088-48bb-8fa9-d28528e5870e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:15.674928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f599-0088-48bb-8fa9-d28528e5870e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:15.675209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36f599-0088-48bb-8fa9-d28528e5870e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:15.722652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6e36f599-0088-48bb-8fa9-d28528e5870e None None] MFA Rules not processed for user `2074fd021729416ea1c9b596d0bb892b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:15.723837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6e36f599-0088-48bb-8fa9-d28528e5870e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:15.792125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 706/1415] 10.222.0.15 () {58 vars in 1039 bytes} [Mon Feb 7 02:34:15 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:15.801376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa198ec6-5404-4872-bc56-dbf2b7ccf715 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:15.814647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa198ec6-5404-4872-bc56-dbf2b7ccf715 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:15.819709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab9031-b300-40cd-9189-9cb4590c10ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:15.820363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab9031-b300-40cd-9189-9cb4590c10ec service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:15.820655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab9031-b300-40cd-9189-9cb4590c10ec service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:15.820934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab9031-b300-40cd-9189-9cb4590c10ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:15.829760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab9031-b300-40cd-9189-9cb4590c10ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:15.831343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab9031-b300-40cd-9189-9cb4590c10ec service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:15.839890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 710/1416] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:34:17.182093 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7d60c-e98e-463e-ab65-712dea11c317 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:17.182648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7d60c-e98e-463e-ab65-712dea11c317 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:17.182648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7d60c-e98e-463e-ab65-712dea11c317 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:17.184621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 707/1417] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:34:17.189739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592510a5-42d5-4d12-89bf-4f4cc5afc112 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:17.190187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592510a5-42d5-4d12-89bf-4f4cc5afc112 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:17.190326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592510a5-42d5-4d12-89bf-4f4cc5afc112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:17.220619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-592510a5-42d5-4d12-89bf-4f4cc5afc112 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:17.222545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-592510a5-42d5-4d12-89bf-4f4cc5afc112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:17.239331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 711/1418] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:17.294860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7d60c-e98e-463e-ab65-712dea11c317 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:17.309552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7d60c-e98e-463e-ab65-712dea11c317 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:17.316373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643276e-912a-4471-83aa-7ea7ab3a9ffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:17.317280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643276e-912a-4471-83aa-7ea7ab3a9ffc service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:17.317698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643276e-912a-4471-83aa-7ea7ab3a9ffc service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:17.318013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643276e-912a-4471-83aa-7ea7ab3a9ffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:17.329212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643276e-912a-4471-83aa-7ea7ab3a9ffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:17.330818 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643276e-912a-4471-83aa-7ea7ab3a9ffc service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:17.342310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 708/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:19.627318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97350f3e-d29f-41b6-9104-0ee19c359e48 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:19.628222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97350f3e-d29f-41b6-9104-0ee19c359e48 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:19.630339 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97350f3e-d29f-41b6-9104-0ee19c359e48 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:19.632939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 712/1420] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:34:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:19.636584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f59c80-93df-4966-a79a-7111f169a8ca None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:19.637027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f59c80-93df-4966-a79a-7111f169a8ca None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:19.637198 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f59c80-93df-4966-a79a-7111f169a8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:19.655539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a1f59c80-93df-4966-a79a-7111f169a8ca None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:19.656773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a1f59c80-93df-4966-a79a-7111f169a8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:19.664735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 709/1421] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:19.709549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97350f3e-d29f-41b6-9104-0ee19c359e48 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:19.725159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97350f3e-d29f-41b6-9104-0ee19c359e48 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:19.730748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bf07a-8063-4782-9cbe-eedccf32ef1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:19.731375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bf07a-8063-4782-9cbe-eedccf32ef1d service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:19.731667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bf07a-8063-4782-9cbe-eedccf32ef1d service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:19.731938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bf07a-8063-4782-9cbe-eedccf32ef1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:19.742451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bf07a-8063-4782-9cbe-eedccf32ef1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:19.743967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bf07a-8063-4782-9cbe-eedccf32ef1d service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:19.754007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 713/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:38.822831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61323f-f629-4342-a549-1447faf885b1 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:38.827524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61323f-f629-4342-a549-1447faf885b1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:38.827524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61323f-f629-4342-a549-1447faf885b1 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:38.827524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 710/1423] 10.222.0.15 () {54 vars in 918 bytes} [Mon Feb 7 02:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:38.830921 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cba6e-0879-49ca-bac5-52ab087d30ac None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:38.831367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cba6e-0879-49ca-bac5-52ab087d30ac None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:38.831468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cba6e-0879-49ca-bac5-52ab087d30ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:38.850163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-dd8cba6e-0879-49ca-bac5-52ab087d30ac None None] MFA Rules not processed for user `b06b37b8f23946ebbb5083a877274ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:38.851335 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dd8cba6e-0879-49ca-bac5-52ab087d30ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:38.860196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 714/1424] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Feb 7 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:38.875167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eec24-ec09-4635-b579-cc06124547a9 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:38.875454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eec24-ec09-4635-b579-cc06124547a9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:38.875731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68eec24-ec09-4635-b579-cc06124547a9 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:38.877578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 711/1425] 10.222.0.15 () {54 vars in 918 bytes} [Mon Feb 7 02:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:38.882028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364466f-fc8a-48b1-aaca-d6338917ae52 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:38.882311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364466f-fc8a-48b1-aaca-d6338917ae52 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:38.882589 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364466f-fc8a-48b1-aaca-d6338917ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:38.900882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6364466f-fc8a-48b1-aaca-d6338917ae52 None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:38.902055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6364466f-fc8a-48b1-aaca-d6338917ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:38.911143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 715/1426] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Feb 7 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:41.571176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc318a8-7a55-4721-859d-2c5d9fb6232a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:41.571719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc318a8-7a55-4721-859d-2c5d9fb6232a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:41.571816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc318a8-7a55-4721-859d-2c5d9fb6232a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:41.573612 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 712/1427] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:41.579061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0b173-53d5-46c4-887e-7f735d9fed2d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:41.579496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0b173-53d5-46c4-887e-7f735d9fed2d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:41.579663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0b173-53d5-46c4-887e-7f735d9fed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:41.597830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e0c0b173-53d5-46c4-887e-7f735d9fed2d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:41.598996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e0c0b173-53d5-46c4-887e-7f735d9fed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:41.607338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 716/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:41.648113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc318a8-7a55-4721-859d-2c5d9fb6232a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:41.662635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc318a8-7a55-4721-859d-2c5d9fb6232a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:41.668673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a546c8-c4d8-4151-8fc2-baa8a90f76d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:41.669298 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a546c8-c4d8-4151-8fc2-baa8a90f76d2 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:41.669579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a546c8-c4d8-4151-8fc2-baa8a90f76d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:41.669853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a546c8-c4d8-4151-8fc2-baa8a90f76d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:41.677908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a546c8-c4d8-4151-8fc2-baa8a90f76d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:41.679485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a546c8-c4d8-4151-8fc2-baa8a90f76d2 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:41.688698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 713/1429] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:43.043738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7c9a4-6b3d-4242-856f-c4bf7bbb74fb None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:43.044302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7c9a4-6b3d-4242-856f-c4bf7bbb74fb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:43.044302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7c9a4-6b3d-4242-856f-c4bf7bbb74fb None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:43.046146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 717/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:43.051353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be8027-08ae-4d31-b206-4e8f71cbb9d4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:43.051791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be8027-08ae-4d31-b206-4e8f71cbb9d4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:43.051906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be8027-08ae-4d31-b206-4e8f71cbb9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:43.071349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-54be8027-08ae-4d31-b206-4e8f71cbb9d4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:43.073183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-54be8027-08ae-4d31-b206-4e8f71cbb9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:43.081343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 714/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:43.239852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7c9a4-6b3d-4242-856f-c4bf7bbb74fb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:43.254413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7c9a4-6b3d-4242-856f-c4bf7bbb74fb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:43.260393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59ba0a-cd09-4c50-9864-64a1c56d6e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:43.261022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ba0a-cd09-4c50-9864-64a1c56d6e9e service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:43.261301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ba0a-cd09-4c50-9864-64a1c56d6e9e service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:43.261570 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59ba0a-cd09-4c50-9864-64a1c56d6e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:43.269511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59ba0a-cd09-4c50-9864-64a1c56d6e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:43.271094 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59ba0a-cd09-4c50-9864-64a1c56d6e9e service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:43.280308 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 718/1432] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:44.591943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead6a2-f8be-48c0-9028-d8e4efcf3ab4 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:44.592493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead6a2-f8be-48c0-9028-d8e4efcf3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:44.592493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ead6a2-f8be-48c0-9028-d8e4efcf3ab4 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:44.594297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 715/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:44.599195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367d9d1-8757-4b24-9a1d-e087812f5dc2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:44.599638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367d9d1-8757-4b24-9a1d-e087812f5dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:44.599748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367d9d1-8757-4b24-9a1d-e087812f5dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:44.618191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1367d9d1-8757-4b24-9a1d-e087812f5dc2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:44.619869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1367d9d1-8757-4b24-9a1d-e087812f5dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:44.627693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 719/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:44.780085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ead6a2-f8be-48c0-9028-d8e4efcf3ab4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:44.793839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ead6a2-f8be-48c0-9028-d8e4efcf3ab4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:44.799085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa527f46-b77e-438e-a67c-49d3b4fe6f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:44.799706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa527f46-b77e-438e-a67c-49d3b4fe6f28 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:44.799983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa527f46-b77e-438e-a67c-49d3b4fe6f28 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:44.800256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa527f46-b77e-438e-a67c-49d3b4fe6f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:44.808708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa527f46-b77e-438e-a67c-49d3b4fe6f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:44.810268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa527f46-b77e-438e-a67c-49d3b4fe6f28 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:44.819270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 716/1435] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:46.119605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3039ba-9a24-4543-98be-3c8347c67d0d None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:46.120114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3039ba-9a24-4543-98be-3c8347c67d0d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:46.120114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3039ba-9a24-4543-98be-3c8347c67d0d None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:46.121881 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 720/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:46.126898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce79a9-1390-428b-bb8f-bfe37a70bb25 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:46.127299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce79a9-1390-428b-bb8f-bfe37a70bb25 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:46.127445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce79a9-1390-428b-bb8f-bfe37a70bb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:46.145678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-dcce79a9-1390-428b-bb8f-bfe37a70bb25 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:46.146845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dcce79a9-1390-428b-bb8f-bfe37a70bb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:46.154497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 717/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:46.302978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3039ba-9a24-4543-98be-3c8347c67d0d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:46.317523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3039ba-9a24-4543-98be-3c8347c67d0d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:46.323749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf94fc-52bc-48d6-bd0a-21cc32c45c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:46.324668 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf94fc-52bc-48d6-bd0a-21cc32c45c78 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:46.324948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf94fc-52bc-48d6-bd0a-21cc32c45c78 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:46.325219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf94fc-52bc-48d6-bd0a-21cc32c45c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:46.333465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf94fc-52bc-48d6-bd0a-21cc32c45c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:46.335041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf94fc-52bc-48d6-bd0a-21cc32c45c78 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:46.344294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 721/1438] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:47.667503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440282e-eec0-48ed-b128-bd0258c65127 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:47.668071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440282e-eec0-48ed-b128-bd0258c65127 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:47.668071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440282e-eec0-48ed-b128-bd0258c65127 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:47.669859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 718/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:47.674745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8969c-a095-48d6-ab82-0dc1979fe954 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:47.675159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8969c-a095-48d6-ab82-0dc1979fe954 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:47.675257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8969c-a095-48d6-ab82-0dc1979fe954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:47.693208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ffa8969c-a095-48d6-ab82-0dc1979fe954 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:47.694377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ffa8969c-a095-48d6-ab82-0dc1979fe954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:47.702942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 722/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:47.853543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440282e-eec0-48ed-b128-bd0258c65127 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:47.867651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440282e-eec0-48ed-b128-bd0258c65127 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:47.873929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5936c2-267e-40a3-81ec-8cb5b763ef7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:47.874563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5936c2-267e-40a3-81ec-8cb5b763ef7e service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:47.874844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5936c2-267e-40a3-81ec-8cb5b763ef7e service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:47.875121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5936c2-267e-40a3-81ec-8cb5b763ef7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:47.883290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5936c2-267e-40a3-81ec-8cb5b763ef7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:47.885530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5936c2-267e-40a3-81ec-8cb5b763ef7e service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:47.895053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 719/1441] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:49.173241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81da24-6e64-484c-a27a-fede9549b8c1 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:49.173797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81da24-6e64-484c-a27a-fede9549b8c1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:49.173797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81da24-6e64-484c-a27a-fede9549b8c1 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:49.175570 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 723/1442] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:49.180466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96438-0715-4cbf-9dec-7abea2aba0e1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:49.181408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96438-0715-4cbf-9dec-7abea2aba0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:49.181529 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb96438-0715-4cbf-9dec-7abea2aba0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:49.200214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bcb96438-0715-4cbf-9dec-7abea2aba0e1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:49.201451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bcb96438-0715-4cbf-9dec-7abea2aba0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:49.209290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 720/1443] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:49.373922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81da24-6e64-484c-a27a-fede9549b8c1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:49.388494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81da24-6e64-484c-a27a-fede9549b8c1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:49.393867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8e5d-b50b-437d-bf3c-50873b7f2e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:49.394486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8e5d-b50b-437d-bf3c-50873b7f2e1f service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:49.394763 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8e5d-b50b-437d-bf3c-50873b7f2e1f service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:49.395035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8e5d-b50b-437d-bf3c-50873b7f2e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:49.402941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8e5d-b50b-437d-bf3c-50873b7f2e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:49.404540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8e5d-b50b-437d-bf3c-50873b7f2e1f service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:49.413916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 724/1444] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:50.660466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21ea0-2144-4a72-8c4c-44674e1a9944 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:50.661045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21ea0-2144-4a72-8c4c-44674e1a9944 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:50.661045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21ea0-2144-4a72-8c4c-44674e1a9944 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:50.662821 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 721/1445] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:50.668505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e769-2ced-4b18-b2c8-9087589b42ed None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:50.668899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e769-2ced-4b18-b2c8-9087589b42ed None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:50.669058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e769-2ced-4b18-b2c8-9087589b42ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:50.687144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-15c5e769-2ced-4b18-b2c8-9087589b42ed None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:50.688313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-15c5e769-2ced-4b18-b2c8-9087589b42ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:50.695932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 725/1446] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:50.854223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e21ea0-2144-4a72-8c4c-44674e1a9944 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:50.868560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e21ea0-2144-4a72-8c4c-44674e1a9944 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:50.873853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb71b8-fda2-41b3-bc80-96fe4147763b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:50.874476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb71b8-fda2-41b3-bc80-96fe4147763b service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:50.874758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb71b8-fda2-41b3-bc80-96fe4147763b service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:50.875032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb71b8-fda2-41b3-bc80-96fe4147763b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:50.882951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb71b8-fda2-41b3-bc80-96fe4147763b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:50.884563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb71b8-fda2-41b3-bc80-96fe4147763b service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:50.893757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 722/1447] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:52.150157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7e199-3c2d-4d34-8eef-bc55dd0190f6 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:52.150734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7e199-3c2d-4d34-8eef-bc55dd0190f6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:52.150734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7e199-3c2d-4d34-8eef-bc55dd0190f6 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:52.152498 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 726/1448] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:52.157477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302076-cf1b-4f4b-8fa2-500678c230cd None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:52.157871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302076-cf1b-4f4b-8fa2-500678c230cd None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:52.158023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71302076-cf1b-4f4b-8fa2-500678c230cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:52.176254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-71302076-cf1b-4f4b-8fa2-500678c230cd None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:52.177461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-71302076-cf1b-4f4b-8fa2-500678c230cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:52.185132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 723/1449] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:34:52.335014 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7e199-3c2d-4d34-8eef-bc55dd0190f6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:52.349700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7e199-3c2d-4d34-8eef-bc55dd0190f6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:52.355650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7688e-eb9f-4674-a958-28b27c2e517b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:52.356306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7688e-eb9f-4674-a958-28b27c2e517b service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:52.356607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7688e-eb9f-4674-a958-28b27c2e517b service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:52.356878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7688e-eb9f-4674-a958-28b27c2e517b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:52.365026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7688e-eb9f-4674-a958-28b27c2e517b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:52.366637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7688e-eb9f-4674-a958-28b27c2e517b service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:52.376502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 727/1450] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:53.631446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffecd6-2ac0-4e88-8823-5990a80f9ac4 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:53.631969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffecd6-2ac0-4e88-8823-5990a80f9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:53.631969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffecd6-2ac0-4e88-8823-5990a80f9ac4 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:53.633821 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 724/1451] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:53.639631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4477f7-044b-45cc-b2d6-6d1ee988ce51 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:53.640046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4477f7-044b-45cc-b2d6-6d1ee988ce51 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:53.640183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4477f7-044b-45cc-b2d6-6d1ee988ce51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:53.658271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9d4477f7-044b-45cc-b2d6-6d1ee988ce51 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:53.659459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9d4477f7-044b-45cc-b2d6-6d1ee988ce51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:53.667256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 728/1452] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:53.820801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffecd6-2ac0-4e88-8823-5990a80f9ac4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:53.835822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffecd6-2ac0-4e88-8823-5990a80f9ac4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:53.841384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab198-df82-4d52-a37a-7fa8f970d6d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:53.842018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab198-df82-4d52-a37a-7fa8f970d6d4 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:53.842302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab198-df82-4d52-a37a-7fa8f970d6d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:53.842578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab198-df82-4d52-a37a-7fa8f970d6d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:53.850653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab198-df82-4d52-a37a-7fa8f970d6d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:53.852237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab198-df82-4d52-a37a-7fa8f970d6d4 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:53.861496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 725/1453] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:55.971918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13cced-dac5-4599-ad2d-63b1a83ceadf None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:55.972476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13cced-dac5-4599-ad2d-63b1a83ceadf None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:55.972476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13cced-dac5-4599-ad2d-63b1a83ceadf None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:55.974195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 729/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:55.979600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe05383-6237-41c1-a7a8-0ac2d7a3fc21 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:55.980034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe05383-6237-41c1-a7a8-0ac2d7a3fc21 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:55.980176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe05383-6237-41c1-a7a8-0ac2d7a3fc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:55.999559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7fe05383-6237-41c1-a7a8-0ac2d7a3fc21 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:56.001271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7fe05383-6237-41c1-a7a8-0ac2d7a3fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:56.009896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 726/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:56.051616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13cced-dac5-4599-ad2d-63b1a83ceadf None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:56.062784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13cced-dac5-4599-ad2d-63b1a83ceadf None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:56.067541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc0008-8664-4ea2-bd83-e9a0855b06f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:56.068241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0008-8664-4ea2-bd83-e9a0855b06f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:56.068551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0008-8664-4ea2-bd83-e9a0855b06f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:56.069043 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc0008-8664-4ea2-bd83-e9a0855b06f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:56.081465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc0008-8664-4ea2-bd83-e9a0855b06f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:56.082913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc0008-8664-4ea2-bd83-e9a0855b06f1 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:56.095030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 730/1456] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:34:58.480818 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d3873-4a69-4789-b418-3db9f938b825 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:58.481373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d3873-4a69-4789-b418-3db9f938b825 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:58.481373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d3873-4a69-4789-b418-3db9f938b825 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:58.483153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 727/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:34:58.488612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cf00b-5595-40ac-8231-bed9263dd3df None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:58.489036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cf00b-5595-40ac-8231-bed9263dd3df None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:58.489161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cf00b-5595-40ac-8231-bed9263dd3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:58.507277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-383cf00b-5595-40ac-8231-bed9263dd3df None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:34:58.508841 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-383cf00b-5595-40ac-8231-bed9263dd3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:34:58.516554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 731/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:34:58.554219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d3873-4a69-4789-b418-3db9f938b825 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:34:58.565850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d3873-4a69-4789-b418-3db9f938b825 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:34:58.569335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872addd-ee94-4732-a1f5-140690c09400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:34:58.569970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872addd-ee94-4732-a1f5-140690c09400 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:34:58.570251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872addd-ee94-4732-a1f5-140690c09400 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:34:58.570523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872addd-ee94-4732-a1f5-140690c09400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:34:58.579780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872addd-ee94-4732-a1f5-140690c09400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:34:58.581945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872addd-ee94-4732-a1f5-140690c09400 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:34:58.591695 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 728/1459] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:01.127501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd9879-9e0d-4371-9485-01149615f8dc None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:01.128104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd9879-9e0d-4371-9485-01149615f8dc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:01.128104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd9879-9e0d-4371-9485-01149615f8dc None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:01.129941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 732/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:01.135464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20687-b4c0-4283-8445-b35d403a7c16 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:01.135900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20687-b4c0-4283-8445-b35d403a7c16 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:01.136101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e20687-b4c0-4283-8445-b35d403a7c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:01.154535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d6e20687-b4c0-4283-8445-b35d403a7c16 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:01.155737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d6e20687-b4c0-4283-8445-b35d403a7c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:01.163699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 729/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:01.203579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd9879-9e0d-4371-9485-01149615f8dc None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:01.215015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd9879-9e0d-4371-9485-01149615f8dc None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:01.218774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d44012-4e77-47f2-9364-3972e26678ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:01.219412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44012-4e77-47f2-9364-3972e26678ab service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:01.219695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44012-4e77-47f2-9364-3972e26678ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:01.219971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44012-4e77-47f2-9364-3972e26678ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:01.229775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d44012-4e77-47f2-9364-3972e26678ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:01.231215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d44012-4e77-47f2-9364-3972e26678ab service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:01.240586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 733/1462] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:03.585504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46236e-35e3-48a0-aee2-6e4b31c0b2ba None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:03.586101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46236e-35e3-48a0-aee2-6e4b31c0b2ba None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:03.586101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46236e-35e3-48a0-aee2-6e4b31c0b2ba None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:03.587880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 730/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:35:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:03.594804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8f38-e9b6-43e9-a17a-545d5f3b0e13 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:03.595265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8f38-e9b6-43e9-a17a-545d5f3b0e13 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:03.595598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8f38-e9b6-43e9-a17a-545d5f3b0e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:03.612888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-654d8f38-e9b6-43e9-a17a-545d5f3b0e13 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:03.614058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-654d8f38-e9b6-43e9-a17a-545d5f3b0e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:03.622167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 734/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:03.660568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46236e-35e3-48a0-aee2-6e4b31c0b2ba None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:03.671611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46236e-35e3-48a0-aee2-6e4b31c0b2ba None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:03.675584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d82c53-7b2e-4881-8b21-681d8083c0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:03.676215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d82c53-7b2e-4881-8b21-681d8083c0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:03.676528 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d82c53-7b2e-4881-8b21-681d8083c0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:03.676933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d82c53-7b2e-4881-8b21-681d8083c0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:03.687716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d82c53-7b2e-4881-8b21-681d8083c0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:03.689183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d82c53-7b2e-4881-8b21-681d8083c0c4 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:03.698468 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 731/1465] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:06.039205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19d07d-a0ee-415c-828f-bce7df8f17bf None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:06.039759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19d07d-a0ee-415c-828f-bce7df8f17bf None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:06.039759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19d07d-a0ee-415c-828f-bce7df8f17bf None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:06.041551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 735/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:06.046966 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a09595-0464-4fd9-beea-9f9f4caa4b5c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:06.047407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a09595-0464-4fd9-beea-9f9f4caa4b5c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:06.047514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a09595-0464-4fd9-beea-9f9f4caa4b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:06.064873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e4a09595-0464-4fd9-beea-9f9f4caa4b5c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:06.066151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e4a09595-0464-4fd9-beea-9f9f4caa4b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:06.075572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 732/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:06.113508 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19d07d-a0ee-415c-828f-bce7df8f17bf None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:06.124018 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19d07d-a0ee-415c-828f-bce7df8f17bf None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:06.127707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438523e-bd25-4ec9-bdd4-856428ef8096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:06.128337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438523e-bd25-4ec9-bdd4-856428ef8096 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:06.128645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438523e-bd25-4ec9-bdd4-856428ef8096 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:06.128918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438523e-bd25-4ec9-bdd4-856428ef8096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:06.138181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438523e-bd25-4ec9-bdd4-856428ef8096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:06.139607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438523e-bd25-4ec9-bdd4-856428ef8096 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:06.148876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 736/1468] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:08.381143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc2d9-1963-4996-bc44-9d2a131c4e52 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:08.381710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc2d9-1963-4996-bc44-9d2a131c4e52 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:08.381710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc2d9-1963-4996-bc44-9d2a131c4e52 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:08.383566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 733/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:08.389069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b390e-4d12-43c2-816a-c58f82a5d44f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:08.389486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b390e-4d12-43c2-816a-c58f82a5d44f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:08.389620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b390e-4d12-43c2-816a-c58f82a5d44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:08.407278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-015b390e-4d12-43c2-816a-c58f82a5d44f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:08.408485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-015b390e-4d12-43c2-816a-c58f82a5d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:08.416672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 737/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:08.455711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acc2d9-1963-4996-bc44-9d2a131c4e52 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:08.466172 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acc2d9-1963-4996-bc44-9d2a131c4e52 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:08.469629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf34a3-5366-41d1-851f-9fb8e1070c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:08.470248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf34a3-5366-41d1-851f-9fb8e1070c16 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:08.470525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf34a3-5366-41d1-851f-9fb8e1070c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:08.470795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf34a3-5366-41d1-851f-9fb8e1070c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:08.479903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf34a3-5366-41d1-851f-9fb8e1070c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:08.481344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf34a3-5366-41d1-851f-9fb8e1070c16 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:08.490423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 734/1471] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:10.730517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd1e1c-0a33-48ae-a9ae-6596e009750c None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:10.731019 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd1e1c-0a33-48ae-a9ae-6596e009750c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:10.731122 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd1e1c-0a33-48ae-a9ae-6596e009750c None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:10.732936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 738/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:10.738128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb316307-253d-4d2f-976a-33dc26d55e2b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:10.738538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb316307-253d-4d2f-976a-33dc26d55e2b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:10.738678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb316307-253d-4d2f-976a-33dc26d55e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:10.756023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-eb316307-253d-4d2f-976a-33dc26d55e2b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:10.757225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-eb316307-253d-4d2f-976a-33dc26d55e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:10.765442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 735/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:10.802158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd1e1c-0a33-48ae-a9ae-6596e009750c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:10.813075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd1e1c-0a33-48ae-a9ae-6596e009750c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:10.816602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5517b6-d09e-4baf-a047-d469200e604b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:10.817223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5517b6-d09e-4baf-a047-d469200e604b service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:10.817502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5517b6-d09e-4baf-a047-d469200e604b service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:10.817771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5517b6-d09e-4baf-a047-d469200e604b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:10.827241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5517b6-d09e-4baf-a047-d469200e604b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:10.828715 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5517b6-d09e-4baf-a047-d469200e604b service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:10.837846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 739/1474] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:13.083905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98bb64-17af-4d39-a1cb-12adc17884b2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:13.084475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98bb64-17af-4d39-a1cb-12adc17884b2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:13.084475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98bb64-17af-4d39-a1cb-12adc17884b2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:13.086263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 736/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:13.092146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341771fd-7173-4fa9-95b5-dc4e0022deee None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:13.092560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341771fd-7173-4fa9-95b5-dc4e0022deee None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:13.092734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341771fd-7173-4fa9-95b5-dc4e0022deee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:13.110827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-341771fd-7173-4fa9-95b5-dc4e0022deee None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:13.112005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-341771fd-7173-4fa9-95b5-dc4e0022deee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:13.119671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 740/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:13.156469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98bb64-17af-4d39-a1cb-12adc17884b2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:13.167406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98bb64-17af-4d39-a1cb-12adc17884b2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:13.170874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4a32f-175e-4459-b51a-05f096f5f42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:13.171500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a32f-175e-4459-b51a-05f096f5f42d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:13.171778 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a32f-175e-4459-b51a-05f096f5f42d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:13.172051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4a32f-175e-4459-b51a-05f096f5f42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:13.180766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4a32f-175e-4459-b51a-05f096f5f42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:13.182184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4a32f-175e-4459-b51a-05f096f5f42d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:13.191238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 737/1477] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:15.399285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0031830-341a-4001-ad56-c07fe91d08a8 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:15.399823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0031830-341a-4001-ad56-c07fe91d08a8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:15.399823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0031830-341a-4001-ad56-c07fe91d08a8 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:15.401656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 741/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:15.407121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4f1be-d958-41ef-8423-70f235d5ff92 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:15.407558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4f1be-d958-41ef-8423-70f235d5ff92 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:15.407664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4f1be-d958-41ef-8423-70f235d5ff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:15.425712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-14c4f1be-d958-41ef-8423-70f235d5ff92 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:15.426883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-14c4f1be-d958-41ef-8423-70f235d5ff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:15.434598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 738/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:15.470928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0031830-341a-4001-ad56-c07fe91d08a8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:15.481964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0031830-341a-4001-ad56-c07fe91d08a8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:15.485495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252820a9-59a2-4611-9c7f-f0ca3fb68bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:15.486117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252820a9-59a2-4611-9c7f-f0ca3fb68bbf service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:15.486392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252820a9-59a2-4611-9c7f-f0ca3fb68bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:15.486676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252820a9-59a2-4611-9c7f-f0ca3fb68bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:15.495246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252820a9-59a2-4611-9c7f-f0ca3fb68bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:15.496709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252820a9-59a2-4611-9c7f-f0ca3fb68bbf service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:15.505786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 742/1480] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:17.717807 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d67230-6c69-47f3-b647-d7d9e8eb4e9a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:17.718305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d67230-6c69-47f3-b647-d7d9e8eb4e9a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:17.718413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d67230-6c69-47f3-b647-d7d9e8eb4e9a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:17.720142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 739/1481] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:17.726588 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7203-c23a-4ec2-a501-440b33036df3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:17.727099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7203-c23a-4ec2-a501-440b33036df3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:17.727205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7203-c23a-4ec2-a501-440b33036df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:17.745260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-987f7203-c23a-4ec2-a501-440b33036df3 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:17.746442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-987f7203-c23a-4ec2-a501-440b33036df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:17.754087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 743/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:17.790236 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d67230-6c69-47f3-b647-d7d9e8eb4e9a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:17.800669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d67230-6c69-47f3-b647-d7d9e8eb4e9a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:17.804138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3a0c6-f0e9-4361-b534-ff062d8212aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:17.804801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a0c6-f0e9-4361-b534-ff062d8212aa service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:17.805601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a0c6-f0e9-4361-b534-ff062d8212aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:17.805875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3a0c6-f0e9-4361-b534-ff062d8212aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:17.814443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a0c6-f0e9-4361-b534-ff062d8212aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:17.815872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3a0c6-f0e9-4361-b534-ff062d8212aa service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:17.825904 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 740/1483] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:34.671877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f7be-6b8c-47aa-a2d6-5d5b7c718ea3 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:34.672504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f7be-6b8c-47aa-a2d6-5d5b7c718ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:34.672504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f7be-6b8c-47aa-a2d6-5d5b7c718ea3 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:34.674236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 744/1484] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:34.679621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432477b-5b68-4691-8584-a53c67a4cbc1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:34.680014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432477b-5b68-4691-8584-a53c67a4cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:34.680171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432477b-5b68-4691-8584-a53c67a4cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:34.698141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a432477b-5b68-4691-8584-a53c67a4cbc1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:34.699569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a432477b-5b68-4691-8584-a53c67a4cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:34.707271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 741/1485] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:35:34.753093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17005b7c-641c-4359-999b-e389d108512f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:34.753381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17005b7c-641c-4359-999b-e389d108512f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:34.753658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17005b7c-641c-4359-999b-e389d108512f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:34.755424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 745/1486] 10.222.0.15 () {54 vars in 962 bytes} [Mon Feb 7 02:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:34.760844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b777-1cd1-4529-8958-11f46cf8ea18 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:34.761132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b777-1cd1-4529-8958-11f46cf8ea18 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:34.761408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b777-1cd1-4529-8958-11f46cf8ea18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:34.779650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7711b777-1cd1-4529-8958-11f46cf8ea18 None None] MFA Rules not processed for user `612a02fb42af490abcba0e75ec8c759f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:34.780850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7711b777-1cd1-4529-8958-11f46cf8ea18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:34.787560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 742/1487] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Feb 7 02:35:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:34.794607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17005b7c-641c-4359-999b-e389d108512f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:34.805495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17005b7c-641c-4359-999b-e389d108512f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:34.808887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed22c3-8fdf-4f88-8ec1-5f01ddce86e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '612a02fb42af490abcba0e75ec8c759f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:34.809501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed22c3-8fdf-4f88-8ec1-5f01ddce86e8 service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:34.809781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed22c3-8fdf-4f88-8ec1-5f01ddce86e8 service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:34.810050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed22c3-8fdf-4f88-8ec1-5f01ddce86e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:34.818743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed22c3-8fdf-4f88-8ec1-5f01ddce86e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:34.820802 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed22c3-8fdf-4f88-8ec1-5f01ddce86e8 service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:34.830061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 746/1488] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:37.130638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc125a-9f5d-4e95-96aa-07d7b8b7c690 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:37.131214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc125a-9f5d-4e95-96aa-07d7b8b7c690 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:37.131214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc125a-9f5d-4e95-96aa-07d7b8b7c690 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:37.133034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 743/1489] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:37.138495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f8f03-5814-4aea-83fa-bc9ce8083a43 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:37.138933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f8f03-5814-4aea-83fa-bc9ce8083a43 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:37.139110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f8f03-5814-4aea-83fa-bc9ce8083a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:37.158950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-aa2f8f03-5814-4aea-83fa-bc9ce8083a43 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:37.160141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-aa2f8f03-5814-4aea-83fa-bc9ce8083a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:37.168638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 747/1490] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:37.192168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc125a-9f5d-4e95-96aa-07d7b8b7c690 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:37.204518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc125a-9f5d-4e95-96aa-07d7b8b7c690 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:37.208866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c42ff-43e9-40fe-86c1-97c4fcf59013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:37.209496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c42ff-43e9-40fe-86c1-97c4fcf59013 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:37.209773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c42ff-43e9-40fe-86c1-97c4fcf59013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:37.210042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c42ff-43e9-40fe-86c1-97c4fcf59013 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:37.211280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c42ff-43e9-40fe-86c1-97c4fcf59013 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:37.213138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c42ff-43e9-40fe-86c1-97c4fcf59013 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:37.226998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 744/1491] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Feb 7 02:35:37 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:35:39.436517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec79426-4074-4dc4-b011-1e1ca8d9d4ce None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:39.437116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec79426-4074-4dc4-b011-1e1ca8d9d4ce None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:39.437116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec79426-4074-4dc4-b011-1e1ca8d9d4ce None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:39.438865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 748/1492] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:39.444136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d6b15-ab35-4af6-8771-893e19f6db18 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:39.444594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d6b15-ab35-4af6-8771-893e19f6db18 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:39.444700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d6b15-ab35-4af6-8771-893e19f6db18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:39.462916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9c1d6b15-ab35-4af6-8771-893e19f6db18 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:39.464096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9c1d6b15-ab35-4af6-8771-893e19f6db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:39.471779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 745/1493] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:35:39.515312 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec79426-4074-4dc4-b011-1e1ca8d9d4ce None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:39.529243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec79426-4074-4dc4-b011-1e1ca8d9d4ce None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:39.534515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc8a76-490d-4efc-97cf-d482d053c06a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:39.535132 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc8a76-490d-4efc-97cf-d482d053c06a service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:39.535408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc8a76-490d-4efc-97cf-d482d053c06a service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:39.535679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc8a76-490d-4efc-97cf-d482d053c06a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:39.543681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc8a76-490d-4efc-97cf-d482d053c06a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:39.545296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc8a76-490d-4efc-97cf-d482d053c06a service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:39.555041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 749/1494] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:41.921710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410b3c5-700a-4dcb-93d4-866ce5d8051d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:41.922256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410b3c5-700a-4dcb-93d4-866ce5d8051d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:41.922256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410b3c5-700a-4dcb-93d4-866ce5d8051d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:41.924091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 746/1495] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:41.929292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fb248-c116-4e48-805f-ef017aa0e8b1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:41.929683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fb248-c116-4e48-805f-ef017aa0e8b1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:41.929783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288fb248-c116-4e48-805f-ef017aa0e8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:41.947596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-288fb248-c116-4e48-805f-ef017aa0e8b1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:41.948805 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-288fb248-c116-4e48-805f-ef017aa0e8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:41.956622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 750/1496] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:41.991913 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410b3c5-700a-4dcb-93d4-866ce5d8051d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:42.002475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410b3c5-700a-4dcb-93d4-866ce5d8051d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:42.005990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efbb6d-bf92-4ee0-88d5-0880c9d8ea6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:42.006607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efbb6d-bf92-4ee0-88d5-0880c9d8ea6a service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:42.006886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efbb6d-bf92-4ee0-88d5-0880c9d8ea6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:42.007158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efbb6d-bf92-4ee0-88d5-0880c9d8ea6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:42.016398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efbb6d-bf92-4ee0-88d5-0880c9d8ea6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:42.017834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efbb6d-bf92-4ee0-88d5-0880c9d8ea6a service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:42.027726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 747/1497] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:44.304763 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc577111-9577-4c50-85af-eed6c38dc08f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:44.305368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc577111-9577-4c50-85af-eed6c38dc08f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:44.305368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc577111-9577-4c50-85af-eed6c38dc08f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:44.307100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 751/1498] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:44.312297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e339b2-3a13-4d19-bce3-4093201035b7 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:44.312728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e339b2-3a13-4d19-bce3-4093201035b7 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:44.312880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e339b2-3a13-4d19-bce3-4093201035b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:44.332054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b0e339b2-3a13-4d19-bce3-4093201035b7 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:44.333282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b0e339b2-3a13-4d19-bce3-4093201035b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:44.341585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 748/1499] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:44.378838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc577111-9577-4c50-85af-eed6c38dc08f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:44.389829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc577111-9577-4c50-85af-eed6c38dc08f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:44.393382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4648c-10ba-4d11-bc34-70cdedf740ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:44.394005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4648c-10ba-4d11-bc34-70cdedf740ad service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:44.394282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4648c-10ba-4d11-bc34-70cdedf740ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:44.394557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4648c-10ba-4d11-bc34-70cdedf740ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:44.403864 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4648c-10ba-4d11-bc34-70cdedf740ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:44.405321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4648c-10ba-4d11-bc34-70cdedf740ad service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:44.414465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 752/1500] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:46.775008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13b3e-1af2-41ca-82f3-ca8a63af63f4 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:46.775551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13b3e-1af2-41ca-82f3-ca8a63af63f4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:46.775551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13b3e-1af2-41ca-82f3-ca8a63af63f4 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:46.777340 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 749/1501] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:46.782534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a092ce-7209-45a0-a2cb-bf6d7ce96a42 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:46.782930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a092ce-7209-45a0-a2cb-bf6d7ce96a42 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:46.783082 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a092ce-7209-45a0-a2cb-bf6d7ce96a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:46.800527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e0a092ce-7209-45a0-a2cb-bf6d7ce96a42 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:46.801717 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e0a092ce-7209-45a0-a2cb-bf6d7ce96a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:46.810016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 753/1502] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:35:46.845703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d13b3e-1af2-41ca-82f3-ca8a63af63f4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:46.858661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d13b3e-1af2-41ca-82f3-ca8a63af63f4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:46.863080 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06f864-96e1-49ca-b734-64f720e6deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:46.863909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f864-96e1-49ca-b734-64f720e6deb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:46.864190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f864-96e1-49ca-b734-64f720e6deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:46.864499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f864-96e1-49ca-b734-64f720e6deb4 admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:46.865695 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f864-96e1-49ca-b734-64f720e6deb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b1044bcdc94a2da05a52b6795082d0)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:46.868016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f864-96e1-49ca-b734-64f720e6deb4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:46.869758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 750/1503] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:35:46 2022] GET /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:35:46.881123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a092ce-7209-45a0-a2cb-bf6d7ce96a42 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:46.890840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a092ce-7209-45a0-a2cb-bf6d7ce96a42 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:46.894394 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994d279-172f-4f57-a16f-eb87e5ea9777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:46.895024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d279-172f-4f57-a16f-eb87e5ea9777 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:46.895303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d279-172f-4f57-a16f-eb87e5ea9777 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:46.895578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d279-172f-4f57-a16f-eb87e5ea9777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:46.904281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994d279-172f-4f57-a16f-eb87e5ea9777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:46.905738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994d279-172f-4f57-a16f-eb87e5ea9777 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:46.914979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 754/1504] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:35:49.421733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d46886-f2aa-431c-9833-e6796e5ea37c None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:49.422308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d46886-f2aa-431c-9833-e6796e5ea37c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:49.422308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d46886-f2aa-431c-9833-e6796e5ea37c None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:49.424042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 751/1505] 10.222.0.15 () {54 vars in 926 bytes} [Mon Feb 7 02:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:35:49.429779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b0eb-5e17-449c-9470-7ce65183ce76 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:49.430231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b0eb-5e17-449c-9470-7ce65183ce76 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:49.430341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b0eb-5e17-449c-9470-7ce65183ce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:49.448502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3af6b0eb-5e17-449c-9470-7ce65183ce76 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:35:49.449934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3af6b0eb-5e17-449c-9470-7ce65183ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:35:49.457590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 755/1506] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Feb 7 02:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:35:49.490996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d46886-f2aa-431c-9833-e6796e5ea37c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:49.503525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d46886-f2aa-431c-9833-e6796e5ea37c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:49.508094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7b6d0-8db2-409a-a715-b1c3f2ba21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:49.508952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7b6d0-8db2-409a-a715-b1c3f2ba21eb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:49.509225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7b6d0-8db2-409a-a715-b1c3f2ba21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:49.509493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7b6d0-8db2-409a-a715-b1c3f2ba21eb admin admin] PATH_INFO: `/v3/projects/f0b1044bcdc94a2da05a52b6795082d0` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:49.510656 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7b6d0-8db2-409a-a715-b1c3f2ba21eb admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b1044bcdc94a2da05a52b6795082d0)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:49.512433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7b6d0-8db2-409a-a715-b1c3f2ba21eb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:49.514065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 752/1507] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Feb 7 02:35:49 2022] GET /identity/v3/projects/f0b1044bcdc94a2da05a52b6795082d0 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:35:49.524869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b0eb-5e17-449c-9470-7ce65183ce76 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:35:49.533986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b0eb-5e17-449c-9470-7ce65183ce76 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:35:49.537527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521ae8d-a6c0-4a5f-9de2-d9eef31bcde5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:35:49.538158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521ae8d-a6c0-4a5f-9de2-d9eef31bcde5 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:35:49.538946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521ae8d-a6c0-4a5f-9de2-d9eef31bcde5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:35:49.539215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521ae8d-a6c0-4a5f-9de2-d9eef31bcde5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:35:49.547842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521ae8d-a6c0-4a5f-9de2-d9eef31bcde5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:35:49.549304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521ae8d-a6c0-4a5f-9de2-d9eef31bcde5 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:35:49.558948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 756/1508] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:37:04.509372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10a59-5223-4a59-ad85-85e037f40086 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:04.509963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10a59-5223-4a59-ad85-85e037f40086 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:04.509963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10a59-5223-4a59-ad85-85e037f40086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:04.528554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-62f10a59-5223-4a59-ad85-85e037f40086 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:37:04.529746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-62f10a59-5223-4a59-ad85-85e037f40086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:37:04.538020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 753/1509] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:37:04.545939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c166b7-0e04-45cb-81e4-35402c7d6bf2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:04.546409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c166b7-0e04-45cb-81e4-35402c7d6bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:04.546527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c166b7-0e04-45cb-81e4-35402c7d6bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:04.564564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-07c166b7-0e04-45cb-81e4-35402c7d6bf2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:37:04.565736 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-07c166b7-0e04-45cb-81e4-35402c7d6bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:37:04.573368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 757/1510] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:37:04.577941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f10a59-5223-4a59-ad85-85e037f40086 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:04.587295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f10a59-5223-4a59-ad85-85e037f40086 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:04.591725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ade365-5736-4ebd-b9ef-c197ef0f2194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:04.592391 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ade365-5736-4ebd-b9ef-c197ef0f2194 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:04.592675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ade365-5736-4ebd-b9ef-c197ef0f2194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:04.592948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ade365-5736-4ebd-b9ef-c197ef0f2194 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:04.593670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ade365-5736-4ebd-b9ef-c197ef0f2194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:37:04.593970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ade365-5736-4ebd-b9ef-c197ef0f2194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:04.595538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ade365-5736-4ebd-b9ef-c197ef0f2194 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:04.607073 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 754/1511] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:37:04.615378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c166b7-0e04-45cb-81e4-35402c7d6bf2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:04.624282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c166b7-0e04-45cb-81e4-35402c7d6bf2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:04.630324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08931f7-b0c2-4cd3-9e49-c30a0672f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:04.630975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08931f7-b0c2-4cd3-9e49-c30a0672f3bc admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:04.631253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08931f7-b0c2-4cd3-9e49-c30a0672f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:04.631526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08931f7-b0c2-4cd3-9e49-c30a0672f3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:04.632219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08931f7-b0c2-4cd3-9e49-c30a0672f3bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:04.634212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08931f7-b0c2-4cd3-9e49-c30a0672f3bc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:04.670330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 758/1512] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:37:04 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:37:04.674879 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ade365-5736-4ebd-b9ef-c197ef0f2194 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:04.685484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ade365-5736-4ebd-b9ef-c197ef0f2194 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:04.738088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed464c-badd-460d-af1f-c328a10f3892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:04.738749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed464c-badd-460d-af1f-c328a10f3892 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:04.739012 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed464c-badd-460d-af1f-c328a10f3892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:04.739280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed464c-badd-460d-af1f-c328a10f3892 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:04.739969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed464c-badd-460d-af1f-c328a10f3892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:04.741925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed464c-badd-460d-af1f-c328a10f3892 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:04.761283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 755/1513] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:37:04 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:37:04.765493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08931f7-b0c2-4cd3-9e49-c30a0672f3bc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:04.776117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08931f7-b0c2-4cd3-9e49-c30a0672f3bc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:04.780665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebfe46-52fb-4476-8d83-0c5fcc956058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:04.781349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebfe46-52fb-4476-8d83-0c5fcc956058 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:04.781627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebfe46-52fb-4476-8d83-0c5fcc956058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:04.781902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebfe46-52fb-4476-8d83-0c5fcc956058 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:04.782632 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebfe46-52fb-4476-8d83-0c5fcc956058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:04.784231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebfe46-52fb-4476-8d83-0c5fcc956058 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:04.796738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 759/1514] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:37:04.800517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed464c-badd-460d-af1f-c328a10f3892 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:04.810801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed464c-badd-460d-af1f-c328a10f3892 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:04.815281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6d015-a15e-4cc1-9be3-2d49dd1c7752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:04.815942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6d015-a15e-4cc1-9be3-2d49dd1c7752 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:04.816219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6d015-a15e-4cc1-9be3-2d49dd1c7752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:04.816532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6d015-a15e-4cc1-9be3-2d49dd1c7752 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:04.817819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6d015-a15e-4cc1-9be3-2d49dd1c7752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:04.819388 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6d015-a15e-4cc1-9be3-2d49dd1c7752 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:04.832830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 756/1515] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:37:04.836933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebfe46-52fb-4476-8d83-0c5fcc956058 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:04.846592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebfe46-52fb-4476-8d83-0c5fcc956058 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:04.851135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23c011-5904-4d0a-a932-575d5974c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:04.852002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23c011-5904-4d0a-a932-575d5974c002 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:04.852279 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23c011-5904-4d0a-a932-575d5974c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:04.852580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23c011-5904-4d0a-a932-575d5974c002 admin admin] PATH_INFO: `/v3/projects/9df6b9c643f14f7aa67012ce9ae4e134/users/85f757b0465a4728b8745f714ba87662/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:04.867001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23c011-5904-4d0a-a932-575d5974c002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df6b9c643f14f7aa67012ce9ae4e134, user_id=85f757b0465a4728b8745f714ba87662, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:04.869689 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23c011-5904-4d0a-a932-575d5974c002 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:04.882348 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 760/1516] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:37:04 2022] PUT /identity/v3/projects/9df6b9c643f14f7aa67012ce9ae4e134/users/85f757b0465a4728b8745f714ba87662/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:37:04.894368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e53e44-8fb1-4626-b98f-804ea4002269 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:04.894659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e53e44-8fb1-4626-b98f-804ea4002269 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:04.894939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e53e44-8fb1-4626-b98f-804ea4002269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:04.920254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-91e53e44-8fb1-4626-b98f-804ea4002269 None None] MFA Rules not processed for user `85f757b0465a4728b8745f714ba87662`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:37:04.921471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-91e53e44-8fb1-4626-b98f-804ea4002269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:37:04.983125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 757/1517] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:37:04.994709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23c011-5904-4d0a-a932-575d5974c002 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:05.061333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23c011-5904-4d0a-a932-575d5974c002 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:05.066682 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de370885-2b84-4405-a2db-3e386d130d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:05.067910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de370885-2b84-4405-a2db-3e386d130d6b service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:05.068187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de370885-2b84-4405-a2db-3e386d130d6b service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:05.068494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de370885-2b84-4405-a2db-3e386d130d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:05.076474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de370885-2b84-4405-a2db-3e386d130d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:05.078196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de370885-2b84-4405-a2db-3e386d130d6b service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:05.087391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 761/1518] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:37:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:37:05.154714 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0899e27-5c85-4814-978b-6f73208ff826 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:05.155004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0899e27-5c85-4814-978b-6f73208ff826 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:05.155305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0899e27-5c85-4814-978b-6f73208ff826 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:05.157086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 758/1519] 10.222.0.15 () {52 vars in 829 bytes} [Mon Feb 7 02:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:37:05.160706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de370885-2b84-4405-a2db-3e386d130d6b service nova] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:05.220864 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de370885-2b84-4405-a2db-3e386d130d6b service nova] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:05.225944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:05.226800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:05.227078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:05.227349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] PATH_INFO: `/v3/users/85f757b0465a4728b8745f714ba87662` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:05.228564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f757b0465a4728b8745f714ba87662)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:05.229587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:37:05.229587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:37:05.229587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:37:05.230773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:05.292115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f757b0465a4728b8745f714ba87662'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.300748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f757b0465a4728b8745f714ba87662'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.313122 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f757b0465a4728b8745f714ba87662'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.331948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f757b0465a4728b8745f714ba87662'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.332692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f757b0465a4728b8745f714ba87662'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.338629 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 762/1520] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:37:05 2022] DELETE /identity/v3/users/85f757b0465a4728b8745f714ba87662 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:37:05.343030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cbdf6-cadc-4bbf-bc43-268a10537c1a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:05.343432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cbdf6-cadc-4bbf-bc43-268a10537c1a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:05.343773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cbdf6-cadc-4bbf-bc43-268a10537c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:05.361512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-547cbdf6-cadc-4bbf-bc43-268a10537c1a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:37:05.362691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-547cbdf6-cadc-4bbf-bc43-268a10537c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:37:05.417974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 759/1521] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:37:05.428229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:05.429626 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:37:05.488786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0438ea-564c-4ed9-bc63-740da8bd1cfb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:05.493032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7e0be-e034-499e-9d82-33da3fb7efce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:05.493672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e0be-e034-499e-9d82-33da3fb7efce service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:05.493951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e0be-e034-499e-9d82-33da3fb7efce service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:05.494227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e0be-e034-499e-9d82-33da3fb7efce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:05.503272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7e0be-e034-499e-9d82-33da3fb7efce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:05.504748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7e0be-e034-499e-9d82-33da3fb7efce service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:05.514150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 763/1522] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:37:05.857810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cbdf6-cadc-4bbf-bc43-268a10537c1a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:37:05.860296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-547cbdf6-cadc-4bbf-bc43-268a10537c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:37:05.872715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cbdf6-cadc-4bbf-bc43-268a10537c1a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:37:05.877952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:37:05.879165 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:37:05.879380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:37:05.880278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] PATH_INFO: `/v3/projects/9df6b9c643f14f7aa67012ce9ae4e134` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:37:05.881588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df6b9c643f14f7aa67012ce9ae4e134)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:37:05.882611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:37:05.882611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:37:05.882611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:37:05.883797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:37:05.943256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df6b9c643f14f7aa67012ce9ae4e134', 'request_id': 'req-206b31b4-4682-4b69-ae94-08213ee79a1e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.956871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df6b9c643f14f7aa67012ce9ae4e134', 'request_id': 'req-206b31b4-4682-4b69-ae94-08213ee79a1e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.962682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df6b9c643f14f7aa67012ce9ae4e134', 'request_id': 'req-206b31b4-4682-4b69-ae94-08213ee79a1e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.978123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] The token cache is being invalidate because project 9df6b9c643f14f7aa67012ce9ae4e134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:37:05.978552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.979274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-206b31b4-4682-4b69-ae94-08213ee79a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:37:05.980868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 760/1523] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:37:05 2022] DELETE /identity/v3/projects/9df6b9c643f14f7aa67012ce9ae4e134 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:38:32.411538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b5a69-297e-4322-aa85-a06936bc0bc2 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:32.412128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b5a69-297e-4322-aa85-a06936bc0bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:32.412128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b5a69-297e-4322-aa85-a06936bc0bc2 None None] PATH_INFO: `/v3` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:32.413412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 764/1524] 10.222.0.13 () {54 vars in 925 bytes} [Mon Feb 7 02:38:32 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:38:32.421211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e84cb-5402-45c5-81e4-5b330b8ddda8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:32.421670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e84cb-5402-45c5-81e4-5b330b8ddda8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:32.421780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e84cb-5402-45c5-81e4-5b330b8ddda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:32.440595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d20e84cb-5402-45c5-81e4-5b330b8ddda8 None None] MFA Rules not processed for user `b06b37b8f23946ebbb5083a877274ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:38:32.441789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d20e84cb-5402-45c5-81e4-5b330b8ddda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:32.503359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 761/1525] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Feb 7 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:38:32.769753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527925-c8b0-499f-8df4-4512ae15fe28 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:32.770051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527925-c8b0-499f-8df4-4512ae15fe28 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:32.770301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527925-c8b0-499f-8df4-4512ae15fe28 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:32.772075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 765/1526] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:38:32.777464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151e708-936c-4148-b3ef-161bb910311b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:32.777771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151e708-936c-4148-b3ef-161bb910311b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:32.778048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151e708-936c-4148-b3ef-161bb910311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:32.796482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c151e708-936c-4148-b3ef-161bb910311b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:38:32.797688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c151e708-936c-4148-b3ef-161bb910311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:32.857280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 762/1527] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:38:33.009775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527925-c8b0-499f-8df4-4512ae15fe28 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:38:33.011378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-73527925-c8b0-499f-8df4-4512ae15fe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:33.083206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527925-c8b0-499f-8df4-4512ae15fe28 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:38:33.088621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e09468-ea28-4be9-92f8-6765a0abcefa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:38:33.089255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09468-ea28-4be9-92f8-6765a0abcefa service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:33.089531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09468-ea28-4be9-92f8-6765a0abcefa service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:33.089806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e09468-ea28-4be9-92f8-6765a0abcefa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:33.098219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e09468-ea28-4be9-92f8-6765a0abcefa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:38:33.099794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e09468-ea28-4be9-92f8-6765a0abcefa service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:38:33.108942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 766/1528] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:38:34.409146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfa9c9-53f5-4ef7-bf45-9d1fdde439f1 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:34.410234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfa9c9-53f5-4ef7-bf45-9d1fdde439f1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:34.410234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfa9c9-53f5-4ef7-bf45-9d1fdde439f1 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:34.412016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 763/1529] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:38:34.416942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a833d-3b58-4c4e-8236-734008edc9d6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:34.417371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a833d-3b58-4c4e-8236-734008edc9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:34.417530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a833d-3b58-4c4e-8236-734008edc9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:34.436299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e27a833d-3b58-4c4e-8236-734008edc9d6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:38:34.437664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e27a833d-3b58-4c4e-8236-734008edc9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:34.446640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 767/1530] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:38:34.603401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfa9c9-53f5-4ef7-bf45-9d1fdde439f1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:38:34.618569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfa9c9-53f5-4ef7-bf45-9d1fdde439f1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:38:34.623965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afe4df-2506-4d6e-b939-04e53a9cac2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:38:34.624634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afe4df-2506-4d6e-b939-04e53a9cac2b service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:34.624917 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afe4df-2506-4d6e-b939-04e53a9cac2b service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:34.625190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afe4df-2506-4d6e-b939-04e53a9cac2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:34.633422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afe4df-2506-4d6e-b939-04e53a9cac2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:38:34.635001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afe4df-2506-4d6e-b939-04e53a9cac2b service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:38:34.644237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 764/1531] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:38:36.377525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f186f-cefd-4634-b26e-fadbb81afc1e None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:36.378063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f186f-cefd-4634-b26e-fadbb81afc1e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:36.378063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f186f-cefd-4634-b26e-fadbb81afc1e None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:36.379819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 768/1532] 10.222.0.15 () {54 vars in 960 bytes} [Mon Feb 7 02:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:38:36.384731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeeba0-6a70-4126-96d4-481e5df3b9f2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:36.385126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeeba0-6a70-4126-96d4-481e5df3b9f2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:36.385278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aeeba0-6a70-4126-96d4-481e5df3b9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:36.403675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b3aeeba0-6a70-4126-96d4-481e5df3b9f2 None None] MFA Rules not processed for user `b06b37b8f23946ebbb5083a877274ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:38:36.404888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b3aeeba0-6a70-4126-96d4-481e5df3b9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:36.413943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 765/1533] 10.222.0.15 () {58 vars in 1057 bytes} [Mon Feb 7 02:38:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:38:36.420879 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f186f-cefd-4634-b26e-fadbb81afc1e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:38:36.433800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f186f-cefd-4634-b26e-fadbb81afc1e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:38:36.438605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0c6cf-35f1-429b-87b7-d81c44f86472 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06b37b8f23946ebbb5083a877274ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:38:36.439213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0c6cf-35f1-429b-87b7-d81c44f86472 service placement] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:36.439488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0c6cf-35f1-429b-87b7-d81c44f86472 service placement] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:36.439758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0c6cf-35f1-429b-87b7-d81c44f86472 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:36.447714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0c6cf-35f1-429b-87b7-d81c44f86472 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:38:36.449565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0c6cf-35f1-429b-87b7-d81c44f86472 service placement] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:38:36.459307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 769/1534] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:38:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:38:46.331486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35036e1-8a06-41cd-8348-4c8b6d27ac87 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:46.332591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35036e1-8a06-41cd-8348-4c8b6d27ac87 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:46.332591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35036e1-8a06-41cd-8348-4c8b6d27ac87 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:46.334363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 766/1535] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:38:46.339297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e6ad1-f1a1-4c97-af20-caa509ef7087 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:46.339696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e6ad1-f1a1-4c97-af20-caa509ef7087 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:46.339835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e6ad1-f1a1-4c97-af20-caa509ef7087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:46.357989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-639e6ad1-f1a1-4c97-af20-caa509ef7087 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:38:46.359153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-639e6ad1-f1a1-4c97-af20-caa509ef7087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:46.366867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 770/1536] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:38:46.521719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35036e1-8a06-41cd-8348-4c8b6d27ac87 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:38:46.535741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35036e1-8a06-41cd-8348-4c8b6d27ac87 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:38:46.541027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57992616-7217-427e-828c-b17c46904cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:38:46.541650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992616-7217-427e-828c-b17c46904cb1 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:46.541929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992616-7217-427e-828c-b17c46904cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:46.542201 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57992616-7217-427e-828c-b17c46904cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:46.550139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992616-7217-427e-828c-b17c46904cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:38:46.551702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57992616-7217-427e-828c-b17c46904cb1 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:38:46.560881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 767/1537] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:38:47.857550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82038d99-9bf3-4d13-a526-804ae481907b None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:47.858102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82038d99-9bf3-4d13-a526-804ae481907b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:47.858102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82038d99-9bf3-4d13-a526-804ae481907b None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:47.859946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 771/1538] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 7 02:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:38:47.864681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46c80-3f0f-4703-961e-3dcbcd4c1dd8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:47.865059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46c80-3f0f-4703-961e-3dcbcd4c1dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:47.865231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46c80-3f0f-4703-961e-3dcbcd4c1dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:47.883307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0ae46c80-3f0f-4703-961e-3dcbcd4c1dd8 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:38:47.884522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0ae46c80-3f0f-4703-961e-3dcbcd4c1dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:47.892262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 768/1539] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 7 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:38:48.051192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82038d99-9bf3-4d13-a526-804ae481907b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:38:48.065110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82038d99-9bf3-4d13-a526-804ae481907b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:38:48.070971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d6c55-bbc0-4b0f-b367-838b07e637a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:38:48.071596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d6c55-bbc0-4b0f-b367-838b07e637a2 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:48.071873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d6c55-bbc0-4b0f-b367-838b07e637a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:48.072146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d6c55-bbc0-4b0f-b367-838b07e637a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:48.080366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d6c55-bbc0-4b0f-b367-838b07e637a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:38:48.082585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d6c55-bbc0-4b0f-b367-838b07e637a2 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:38:48.091739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 772/1540] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:38:52.492589 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527284c-9d0f-4c14-944d-0618670ff612 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:52.493190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527284c-9d0f-4c14-944d-0618670ff612 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:52.493190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527284c-9d0f-4c14-944d-0618670ff612 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:52.495002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 769/1541] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:38:52.500145 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3e6d-fad6-41d4-881a-a63dcb30b962 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:52.500616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3e6d-fad6-41d4-881a-a63dcb30b962 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:52.500737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3e6d-fad6-41d4-881a-a63dcb30b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:52.519268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d14a3e6d-fad6-41d4-881a-a63dcb30b962 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:38:52.520603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d14a3e6d-fad6-41d4-881a-a63dcb30b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:52.528183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 773/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:38:52.565428 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527284c-9d0f-4c14-944d-0618670ff612 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:38:52.567075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3527284c-9d0f-4c14-944d-0618670ff612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:52.622406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527284c-9d0f-4c14-944d-0618670ff612 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:38:52.625897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd481c89-bc31-419d-8d32-b41a113f42fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:38:52.626536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481c89-bc31-419d-8d32-b41a113f42fc service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:52.626815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481c89-bc31-419d-8d32-b41a113f42fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:52.627086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481c89-bc31-419d-8d32-b41a113f42fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:52.636006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481c89-bc31-419d-8d32-b41a113f42fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:38:52.637461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481c89-bc31-419d-8d32-b41a113f42fc service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:38:52.646633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 770/1543] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:38:54.869938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481be006-6bab-4cf0-a8a2-15eabab40fee None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:54.870495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481be006-6bab-4cf0-a8a2-15eabab40fee None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:54.870495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481be006-6bab-4cf0-a8a2-15eabab40fee None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:54.872270 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 774/1544] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:38:54.877432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0009529-4674-4dbe-928f-9ae6546c9672 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:54.877821 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0009529-4674-4dbe-928f-9ae6546c9672 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:54.877982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0009529-4674-4dbe-928f-9ae6546c9672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:54.897029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d0009529-4674-4dbe-928f-9ae6546c9672 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:38:54.900995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d0009529-4674-4dbe-928f-9ae6546c9672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:54.909987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 771/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:38:54.946582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481be006-6bab-4cf0-a8a2-15eabab40fee None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:38:54.948262 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-481be006-6bab-4cf0-a8a2-15eabab40fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:54.961918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481be006-6bab-4cf0-a8a2-15eabab40fee None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:38:54.965551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9175e5-aa39-4adf-9ebb-0b3ad3ae5937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:38:54.966214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9175e5-aa39-4adf-9ebb-0b3ad3ae5937 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:54.966486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9175e5-aa39-4adf-9ebb-0b3ad3ae5937 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:54.966755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9175e5-aa39-4adf-9ebb-0b3ad3ae5937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:54.975496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9175e5-aa39-4adf-9ebb-0b3ad3ae5937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:38:54.976943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9175e5-aa39-4adf-9ebb-0b3ad3ae5937 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:38:54.985983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 775/1546] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:38:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:38:58.906951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bf8c-6b77-4145-a6a4-e747bccccb0b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:58.907481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bf8c-6b77-4145-a6a4-e747bccccb0b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:58.907481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bf8c-6b77-4145-a6a4-e747bccccb0b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:58.909364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 772/1547] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:38:58.914691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebf767-202b-4f69-baf7-8f777a494cd7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:58.915127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebf767-202b-4f69-baf7-8f777a494cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:58.915230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebf767-202b-4f69-baf7-8f777a494cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:58.937022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-15ebf767-202b-4f69-baf7-8f777a494cd7 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:38:58.938129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-15ebf767-202b-4f69-baf7-8f777a494cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:58.946842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 776/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:38:59.201517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bf8c-6b77-4145-a6a4-e747bccccb0b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:38:59.203095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2d73bf8c-6b77-4145-a6a4-e747bccccb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:38:59.258789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bf8c-6b77-4145-a6a4-e747bccccb0b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:38:59.262331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76c000-25fb-46a1-aea9-e67b1bf5ee04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:38:59.262961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76c000-25fb-46a1-aea9-e67b1bf5ee04 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:38:59.263241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76c000-25fb-46a1-aea9-e67b1bf5ee04 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:38:59.263515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76c000-25fb-46a1-aea9-e67b1bf5ee04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:38:59.272888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76c000-25fb-46a1-aea9-e67b1bf5ee04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:38:59.274316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76c000-25fb-46a1-aea9-e67b1bf5ee04 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:38:59.283522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 773/1549] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:39:01.536249 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29807f9-8c2c-417a-aee9-26cf16fa7662 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:39:01.536813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29807f9-8c2c-417a-aee9-26cf16fa7662 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:39:01.536813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29807f9-8c2c-417a-aee9-26cf16fa7662 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:39:01.538617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 777/1550] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 7 02:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:39:01.543935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5172de-9019-4977-accc-d56a62b7658e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:39:01.544367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5172de-9019-4977-accc-d56a62b7658e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:39:01.544539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5172de-9019-4977-accc-d56a62b7658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:39:01.562986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3f5172de-9019-4977-accc-d56a62b7658e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:39:01.564163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3f5172de-9019-4977-accc-d56a62b7658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:39:01.571904 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 774/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 7 02:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:39:01.822134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2c030-f3f7-427e-b13a-d882627a654a None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:39:01.822330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2c030-f3f7-427e-b13a-d882627a654a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:39:01.822594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2c030-f3f7-427e-b13a-d882627a654a None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:39:01.824661 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 778/1552] 10.222.0.15 () {54 vars in 963 bytes} [Mon Feb 7 02:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:39:01.829541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c445b-a519-4f3e-ad3c-08a630db561e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:39:01.829822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c445b-a519-4f3e-ad3c-08a630db561e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:39:01.830096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c445b-a519-4f3e-ad3c-08a630db561e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:39:01.848893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e42c445b-a519-4f3e-ad3c-08a630db561e None None] MFA Rules not processed for user `2e738156764e4b038adc89cf114ccda3`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:39:01.850052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e42c445b-a519-4f3e-ad3c-08a630db561e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:39:01.856394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 775/1553] 10.222.0.15 () {58 vars in 1060 bytes} [Mon Feb 7 02:39:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:39:01.863604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2c030-f3f7-427e-b13a-d882627a654a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:39:01.873705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2c030-f3f7-427e-b13a-d882627a654a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:39:01.877193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d600d4d-02dc-47bf-9aff-a781008a7106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:39:01.877798 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600d4d-02dc-47bf-9aff-a781008a7106 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:39:01.878072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600d4d-02dc-47bf-9aff-a781008a7106 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:39:01.878340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d600d4d-02dc-47bf-9aff-a781008a7106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:39:01.886826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d600d4d-02dc-47bf-9aff-a781008a7106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:39:01.888235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d600d4d-02dc-47bf-9aff-a781008a7106 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:39:01.897755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 779/1554] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:24.431283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b468ec-42e4-425c-8731-b104e368e51c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.431928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b468ec-42e4-425c-8731-b104e368e51c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.431928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b468ec-42e4-425c-8731-b104e368e51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.457348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a5b468ec-42e4-425c-8731-b104e368e51c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:24.458957 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a5b468ec-42e4-425c-8731-b104e368e51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:24.471822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 776/1555] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:24.482409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f505ce-57a3-420d-a140-9e2e0487e17a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.483326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f505ce-57a3-420d-a140-9e2e0487e17a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.483784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f505ce-57a3-420d-a140-9e2e0487e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.513468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b6f505ce-57a3-420d-a140-9e2e0487e17a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:24.514945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b6f505ce-57a3-420d-a140-9e2e0487e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:24.527103 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 780/1556] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:24.531934 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b468ec-42e4-425c-8731-b104e368e51c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:24.542815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b468ec-42e4-425c-8731-b104e368e51c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:24.553571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893151d2-8042-4e5f-8c29-702de53aa128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:24.554249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893151d2-8042-4e5f-8c29-702de53aa128 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.554530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893151d2-8042-4e5f-8c29-702de53aa128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.554805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893151d2-8042-4e5f-8c29-702de53aa128 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.555548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893151d2-8042-4e5f-8c29-702de53aa128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:24.555854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893151d2-8042-4e5f-8c29-702de53aa128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:24.557504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893151d2-8042-4e5f-8c29-702de53aa128 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:24.575498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 777/1557] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:24.583386 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f505ce-57a3-420d-a140-9e2e0487e17a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:24.596029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f505ce-57a3-420d-a140-9e2e0487e17a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:24.603259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9d55-7697-4855-8f8a-a2f03bcde120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:24.604198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9d55-7697-4855-8f8a-a2f03bcde120 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.604755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9d55-7697-4855-8f8a-a2f03bcde120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.605277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9d55-7697-4855-8f8a-a2f03bcde120 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.606238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa9d55-7697-4855-8f8a-a2f03bcde120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:24.608413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa9d55-7697-4855-8f8a-a2f03bcde120 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:24.643186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c751d-9f3b-492b-800a-e27754ab3df1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.644567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c751d-9f3b-492b-800a-e27754ab3df1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.645331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c751d-9f3b-492b-800a-e27754ab3df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.656295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 781/1558] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:24.665809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9d55-7697-4855-8f8a-a2f03bcde120 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:24.672485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-347c751d-9f3b-492b-800a-e27754ab3df1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:24.673919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-347c751d-9f3b-492b-800a-e27754ab3df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:24.809713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9d55-7697-4855-8f8a-a2f03bcde120 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:24.810976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 778/1559] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:24.812315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8075fd-c766-499f-9933-c79c0bcd3405 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.816688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8075fd-c766-499f-9933-c79c0bcd3405 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.816977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8075fd-c766-499f-9933-c79c0bcd3405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.823016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c4cdb-5127-4067-be9c-028679fd537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:24.824051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c4cdb-5127-4067-be9c-028679fd537c admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.824337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c4cdb-5127-4067-be9c-028679fd537c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.824729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c4cdb-5127-4067-be9c-028679fd537c admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.825449 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c4cdb-5127-4067-be9c-028679fd537c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:24.827820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c4cdb-5127-4067-be9c-028679fd537c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:24.849178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ce8075fd-c766-499f-9933-c79c0bcd3405 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:24.850976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ce8075fd-c766-499f-9933-c79c0bcd3405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:24.862423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 779/1560] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:24.869527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 782/1561] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:24.869527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3bb97-b936-4dab-91b5-6b98798f65de None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.869527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3bb97-b936-4dab-91b5-6b98798f65de None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.869527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3bb97-b936-4dab-91b5-6b98798f65de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.870341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a599b-694e-4080-a625-035f9c02d237 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.870687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a599b-694e-4080-a625-035f9c02d237 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.871109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a599b-694e-4080-a625-035f9c02d237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.901431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a17a599b-694e-4080-a625-035f9c02d237 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:24.902650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a17a599b-694e-4080-a625-035f9c02d237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:24.912655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 780/1562] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:24.914197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed2827-77fb-4482-a620-c4e9a0ef9346 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.914484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed2827-77fb-4482-a620-c4e9a0ef9346 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.914758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed2827-77fb-4482-a620-c4e9a0ef9346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.916240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-18b3bb97-b936-4dab-91b5-6b98798f65de None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:24.917847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-18b3bb97-b936-4dab-91b5-6b98798f65de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:24.928261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 783/1563] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:24.929199 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3bb97-b936-4dab-91b5-6b98798f65de None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:24.937627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-47ed2827-77fb-4482-a620-c4e9a0ef9346 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:24.939027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-47ed2827-77fb-4482-a620-c4e9a0ef9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:24.942056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3bb97-b936-4dab-91b5-6b98798f65de None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:24.947428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fa72b-11e1-45df-b1a4-49331a869b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:24.947855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 781/1564] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:24.948081 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa72b-11e1-45df-b1a4-49331a869b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.948655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa72b-11e1-45df-b1a4-49331a869b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.948930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa72b-11e1-45df-b1a4-49331a869b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.949678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fa72b-11e1-45df-b1a4-49331a869b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:24.951275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fa72b-11e1-45df-b1a4-49331a869b0a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:24.953733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0d6e-9dd8-4dfa-864f-6b892eb091dd None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.954271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0d6e-9dd8-4dfa-864f-6b892eb091dd None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.954866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f0d6e-9dd8-4dfa-864f-6b892eb091dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.961534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 784/1565] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:24.962793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32764606-1893-47ef-8449-2c49a1d7eded None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.963056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32764606-1893-47ef-8449-2c49a1d7eded None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.963329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32764606-1893-47ef-8449-2c49a1d7eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.976486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f11f0d6e-9dd8-4dfa-864f-6b892eb091dd None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:24.978044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f11f0d6e-9dd8-4dfa-864f-6b892eb091dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:24.981118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-32764606-1893-47ef-8449-2c49a1d7eded None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:24.982277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-32764606-1893-47ef-8449-2c49a1d7eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:24.987293 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 782/1566] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:24.988300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0d6e-9dd8-4dfa-864f-6b892eb091dd None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:24.993502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 785/1567] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:24.994811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fe939-07a5-4771-9735-4bf3493ef0e0 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:24.995099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fe939-07a5-4771-9735-4bf3493ef0e0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:24.995372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fe939-07a5-4771-9735-4bf3493ef0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:24.999671 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f0d6e-9dd8-4dfa-864f-6b892eb091dd None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.006085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da45c1-8664-4114-97db-e7365ac16bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.006800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da45c1-8664-4114-97db-e7365ac16bdb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.007087 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da45c1-8664-4114-97db-e7365ac16bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.007358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da45c1-8664-4114-97db-e7365ac16bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.008099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da45c1-8664-4114-97db-e7365ac16bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:25.008689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da45c1-8664-4114-97db-e7365ac16bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.010067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da45c1-8664-4114-97db-e7365ac16bdb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.014042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0b5fe939-07a5-4771-9735-4bf3493ef0e0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:25.015227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0b5fe939-07a5-4771-9735-4bf3493ef0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:25.029440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 783/1568] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:25.029631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 786/1569] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:25.029631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33286885-c0a3-4c71-a346-961c87931835 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.029631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33286885-c0a3-4c71-a346-961c87931835 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.029631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33286885-c0a3-4c71-a346-961c87931835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.030401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e40dcd-3886-430a-b5e0-a7c68adcb00f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.030401 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e40dcd-3886-430a-b5e0-a7c68adcb00f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.030743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e40dcd-3886-430a-b5e0-a7c68adcb00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.050458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-51e40dcd-3886-430a-b5e0-a7c68adcb00f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:25.050696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-33286885-c0a3-4c71-a346-961c87931835 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:25.051649 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-51e40dcd-3886-430a-b5e0-a7c68adcb00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:25.051839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-33286885-c0a3-4c71-a346-961c87931835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:25.060062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 784/1570] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:25.060861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e40dcd-3886-430a-b5e0-a7c68adcb00f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.063439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 787/1571] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:25.063439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33286885-c0a3-4c71-a346-961c87931835 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.072041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33286885-c0a3-4c71-a346-961c87931835 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.073066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e40dcd-3886-430a-b5e0-a7c68adcb00f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.076888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964516ec-617b-47e0-bd11-91ae44ffac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.077528 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964516ec-617b-47e0-bd11-91ae44ffac02 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.077805 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964516ec-617b-47e0-bd11-91ae44ffac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.077918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310f813-c236-40e5-aed2-128e5df81946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.078078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964516ec-617b-47e0-bd11-91ae44ffac02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.078452 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310f813-c236-40e5-aed2-128e5df81946 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.078733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310f813-c236-40e5-aed2-128e5df81946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.078915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964516ec-617b-47e0-bd11-91ae44ffac02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:25.079021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310f813-c236-40e5-aed2-128e5df81946 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.079223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964516ec-617b-47e0-bd11-91ae44ffac02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.079720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310f813-c236-40e5-aed2-128e5df81946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.080874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964516ec-617b-47e0-bd11-91ae44ffac02 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.081334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310f813-c236-40e5-aed2-128e5df81946 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.092448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 785/1572] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:25.092716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 788/1573] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:25.093693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c23f-886c-48de-b5e7-923502838475 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.093978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c23f-886c-48de-b5e7-923502838475 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.094326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5c23f-886c-48de-b5e7-923502838475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.096960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69d318-7705-4aee-9450-02fbb7698fc3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.097487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69d318-7705-4aee-9450-02fbb7698fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.097826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69d318-7705-4aee-9450-02fbb7698fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.117969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d3a5c23f-886c-48de-b5e7-923502838475 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:25.119177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d3a5c23f-886c-48de-b5e7-923502838475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:25.121032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2b69d318-7705-4aee-9450-02fbb7698fc3 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:25.122212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2b69d318-7705-4aee-9450-02fbb7698fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:25.127267 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 789/1574] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:25.128092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5c23f-886c-48de-b5e7-923502838475 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.130229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 786/1575] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:25.131903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb159d4-0043-495b-a46c-6d68a6c51869 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.132189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb159d4-0043-495b-a46c-6d68a6c51869 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.132500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb159d4-0043-495b-a46c-6d68a6c51869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.138332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5c23f-886c-48de-b5e7-923502838475 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.142848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680ba05-98c6-43cb-aaca-7a96b41f8c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.143489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680ba05-98c6-43cb-aaca-7a96b41f8c06 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.143769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680ba05-98c6-43cb-aaca-7a96b41f8c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.144042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680ba05-98c6-43cb-aaca-7a96b41f8c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.144770 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680ba05-98c6-43cb-aaca-7a96b41f8c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.146710 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680ba05-98c6-43cb-aaca-7a96b41f8c06 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.150292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-abb159d4-0043-495b-a46c-6d68a6c51869 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:25.151473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-abb159d4-0043-495b-a46c-6d68a6c51869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:25.159260 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 787/1576] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:25.160030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb159d4-0043-495b-a46c-6d68a6c51869 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.169879 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb159d4-0043-495b-a46c-6d68a6c51869 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.174115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 790/1577] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.174457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc0a84-7ab4-47d9-b347-a4298a6fd0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.175105 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc0a84-7ab4-47d9-b347-a4298a6fd0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.175365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680ba05-98c6-43cb-aaca-7a96b41f8c06 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.175466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc0a84-7ab4-47d9-b347-a4298a6fd0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.175708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc0a84-7ab4-47d9-b347-a4298a6fd0f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.176406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc0a84-7ab4-47d9-b347-a4298a6fd0f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:25.176717 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc0a84-7ab4-47d9-b347-a4298a6fd0f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.178862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc0a84-7ab4-47d9-b347-a4298a6fd0f5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.190484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 788/1578] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:25.191116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc0a84-7ab4-47d9-b347-a4298a6fd0f5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.201568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc0a84-7ab4-47d9-b347-a4298a6fd0f5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.235398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680ba05-98c6-43cb-aaca-7a96b41f8c06 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.240542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8057-475a-4d66-98e7-a17e2fdb0fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.241207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8057-475a-4d66-98e7-a17e2fdb0fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.241491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8057-475a-4d66-98e7-a17e2fdb0fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.241769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8057-475a-4d66-98e7-a17e2fdb0fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.242493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea8057-475a-4d66-98e7-a17e2fdb0fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:25.242799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea8057-475a-4d66-98e7-a17e2fdb0fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.244428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea8057-475a-4d66-98e7-a17e2fdb0fb9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.255232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188365-8bf0-44b2-b112-59c6f565e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.255840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 791/1579] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:25.256110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188365-8bf0-44b2-b112-59c6f565e987 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.256497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188365-8bf0-44b2-b112-59c6f565e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.256772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188365-8bf0-44b2-b112-59c6f565e987 admin admin] PATH_INFO: `/v3/projects/e2b67816a87a4464882049359fd6bb2f/users/1615be81905a4e67ac3b34ab9f913b4d/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.257323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8057-475a-4d66-98e7-a17e2fdb0fb9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.268253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8057-475a-4d66-98e7-a17e2fdb0fb9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.273264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d636cc-4c13-440d-a351-524cb525df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.273904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d636cc-4c13-440d-a351-524cb525df7c admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.274185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d636cc-4c13-440d-a351-524cb525df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.274581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d636cc-4c13-440d-a351-524cb525df7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.275156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d636cc-4c13-440d-a351-524cb525df7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.275396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5188365-8bf0-44b2-b112-59c6f565e987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b67816a87a4464882049359fd6bb2f, user_id=1615be81905a4e67ac3b34ab9f913b4d, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.277124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d636cc-4c13-440d-a351-524cb525df7c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.278248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5188365-8bf0-44b2-b112-59c6f565e987 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.290729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 789/1580] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:25 2022] PUT /identity/v3/projects/e2b67816a87a4464882049359fd6bb2f/users/1615be81905a4e67ac3b34ab9f913b4d/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:25.291525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188365-8bf0-44b2-b112-59c6f565e987 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.309679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 792/1581] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.310772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d636cc-4c13-440d-a351-524cb525df7c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.366012 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188365-8bf0-44b2-b112-59c6f565e987 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.370612 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7dff4-23b0-49fc-ae9b-99ae622b0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.371337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7dff4-23b0-49fc-ae9b-99ae622b0d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.371549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7dff4-23b0-49fc-ae9b-99ae622b0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.371825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7dff4-23b0-49fc-ae9b-99ae622b0d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.372581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7dff4-23b0-49fc-ae9b-99ae622b0d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:25.372890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7dff4-23b0-49fc-ae9b-99ae622b0d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.373752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d636cc-4c13-440d-a351-524cb525df7c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.374486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7dff4-23b0-49fc-ae9b-99ae622b0d92 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.378601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30ee3-2797-4f2e-8305-dbffb3c01e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.379251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30ee3-2797-4f2e-8305-dbffb3c01e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.379531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30ee3-2797-4f2e-8305-dbffb3c01e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.379804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30ee3-2797-4f2e-8305-dbffb3c01e81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.380612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30ee3-2797-4f2e-8305-dbffb3c01e81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:25.380924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30ee3-2797-4f2e-8305-dbffb3c01e81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.382539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30ee3-2797-4f2e-8305-dbffb3c01e81 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.385693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 790/1582] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:25.387085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ad46a-8378-4400-80e7-eb94b34ebd3a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.387370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ad46a-8378-4400-80e7-eb94b34ebd3a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.387651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ad46a-8378-4400-80e7-eb94b34ebd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.393719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 793/1583] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:25.397229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30ee3-2797-4f2e-8305-dbffb3c01e81 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.406095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e55ad46a-8378-4400-80e7-eb94b34ebd3a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:25.407049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30ee3-2797-4f2e-8305-dbffb3c01e81 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.407287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e55ad46a-8378-4400-80e7-eb94b34ebd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:25.412197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33575bf4-c1e6-4492-9e94-6907c1392672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.412873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33575bf4-c1e6-4492-9e94-6907c1392672 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.413147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33575bf4-c1e6-4492-9e94-6907c1392672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.413416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33575bf4-c1e6-4492-9e94-6907c1392672 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.414255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33575bf4-c1e6-4492-9e94-6907c1392672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.415886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 791/1584] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:25.416723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ad46a-8378-4400-80e7-eb94b34ebd3a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.419667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33575bf4-c1e6-4492-9e94-6907c1392672 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.425729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ad46a-8378-4400-80e7-eb94b34ebd3a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.431543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20524f7-a847-4f9d-883b-92e774f60ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.432264 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20524f7-a847-4f9d-883b-92e774f60ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.432588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20524f7-a847-4f9d-883b-92e774f60ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.432864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20524f7-a847-4f9d-883b-92e774f60ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.433575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20524f7-a847-4f9d-883b-92e774f60ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.435731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20524f7-a847-4f9d-883b-92e774f60ea6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.442424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 794/1585] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.442424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33575bf4-c1e6-4492-9e94-6907c1392672 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.450102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33575bf4-c1e6-4492-9e94-6907c1392672 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.455297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408ea2e-ea70-49a0-9019-c27ee380a50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.455937 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408ea2e-ea70-49a0-9019-c27ee380a50e admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.456209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408ea2e-ea70-49a0-9019-c27ee380a50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.456511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408ea2e-ea70-49a0-9019-c27ee380a50e admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.457204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408ea2e-ea70-49a0-9019-c27ee380a50e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.459120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408ea2e-ea70-49a0-9019-c27ee380a50e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.461799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 792/1586] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.462463 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20524f7-a847-4f9d-883b-92e774f60ea6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.486461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 795/1587] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.487529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e122f77-292d-4180-a34e-cdc61cd10139 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.487739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e122f77-292d-4180-a34e-cdc61cd10139 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.487931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e122f77-292d-4180-a34e-cdc61cd10139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.513706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0e122f77-292d-4180-a34e-cdc61cd10139 None None] MFA Rules not processed for user `1615be81905a4e67ac3b34ab9f913b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:25.514905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0e122f77-292d-4180-a34e-cdc61cd10139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:25.530212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20524f7-a847-4f9d-883b-92e774f60ea6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.577496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 796/1588] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:25.579094 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e122f77-292d-4180-a34e-cdc61cd10139 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.590102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a9576-89fd-4d13-b649-fc5d450133c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.590771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a9576-89fd-4d13-b649-fc5d450133c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.591108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a9576-89fd-4d13-b649-fc5d450133c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.591391 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a9576-89fd-4d13-b649-fc5d450133c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.592096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a9576-89fd-4d13-b649-fc5d450133c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.594119 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a9576-89fd-4d13-b649-fc5d450133c1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.617501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 793/1589] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.617501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a9576-89fd-4d13-b649-fc5d450133c1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.624395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a9576-89fd-4d13-b649-fc5d450133c1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.632635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3de2a-b2c3-4b8d-a724-51d3d235304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.633284 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3de2a-b2c3-4b8d-a724-51d3d235304c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.633582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3de2a-b2c3-4b8d-a724-51d3d235304c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.633839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3de2a-b2c3-4b8d-a724-51d3d235304c admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.634535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3de2a-b2c3-4b8d-a724-51d3d235304c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.636451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3de2a-b2c3-4b8d-a724-51d3d235304c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.641452 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e122f77-292d-4180-a34e-cdc61cd10139 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.646549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fb0aa-c576-47ea-a95a-f1489754a18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.647200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fb0aa-c576-47ea-a95a-f1489754a18d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.647474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fb0aa-c576-47ea-a95a-f1489754a18d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.647744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fb0aa-c576-47ea-a95a-f1489754a18d admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.648466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fb0aa-c576-47ea-a95a-f1489754a18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.650351 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fb0aa-c576-47ea-a95a-f1489754a18d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.663469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 794/1590] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.664417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3de2a-b2c3-4b8d-a724-51d3d235304c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.676795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 797/1591] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.677779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fb0aa-c576-47ea-a95a-f1489754a18d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.727257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3de2a-b2c3-4b8d-a724-51d3d235304c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.731894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f8057-fea1-4b31-a19d-0279915d0770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.732574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8057-fea1-4b31-a19d-0279915d0770 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.732859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8057-fea1-4b31-a19d-0279915d0770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.733136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f8057-fea1-4b31-a19d-0279915d0770 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.733869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f8057-fea1-4b31-a19d-0279915d0770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:25.734164 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f8057-fea1-4b31-a19d-0279915d0770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.735470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fb0aa-c576-47ea-a95a-f1489754a18d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.735757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f8057-fea1-4b31-a19d-0279915d0770 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.740226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15274da8-52be-4acd-83e8-31c5bfef7602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.740847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15274da8-52be-4acd-83e8-31c5bfef7602 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.741125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15274da8-52be-4acd-83e8-31c5bfef7602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.741398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15274da8-52be-4acd-83e8-31c5bfef7602 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.742133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15274da8-52be-4acd-83e8-31c5bfef7602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.743720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15274da8-52be-4acd-83e8-31c5bfef7602 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.747263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 795/1592] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:25.748166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f8057-fea1-4b31-a19d-0279915d0770 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.756077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 798/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:25.756077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15274da8-52be-4acd-83e8-31c5bfef7602 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.760359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f8057-fea1-4b31-a19d-0279915d0770 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.763537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15274da8-52be-4acd-83e8-31c5bfef7602 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.765048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62bc98-f9d4-4e2e-a0d6-12e367463d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.765758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62bc98-f9d4-4e2e-a0d6-12e367463d3a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.766037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62bc98-f9d4-4e2e-a0d6-12e367463d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.766307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62bc98-f9d4-4e2e-a0d6-12e367463d3a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.766990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62bc98-f9d4-4e2e-a0d6-12e367463d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.768444 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91384e-f724-46aa-96f5-51a7afc8a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.768911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62bc98-f9d4-4e2e-a0d6-12e367463d3a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.769077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91384e-f724-46aa-96f5-51a7afc8a7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.769354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91384e-f724-46aa-96f5-51a7afc8a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.769627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91384e-f724-46aa-96f5-51a7afc8a7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.770308 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91384e-f724-46aa-96f5-51a7afc8a7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.772792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91384e-f724-46aa-96f5-51a7afc8a7a9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.793044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 796/1594] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.793044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ca8d-211c-4d63-a1e7-fa5d793b4bf2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.793044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ca8d-211c-4d63-a1e7-fa5d793b4bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.793044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7ca8d-211c-4d63-a1e7-fa5d793b4bf2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.793738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 797/1595] 10.222.0.15 () {54 vars in 961 bytes} [Mon Feb 7 02:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:40:25.794338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7ca8d-211c-4d63-a1e7-fa5d793b4bf2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.800412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 799/1596] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.801406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91384e-f724-46aa-96f5-51a7afc8a7a9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.806935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7ca8d-211c-4d63-a1e7-fa5d793b4bf2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.811467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c602bf5-7e75-4e5f-aba7-428fba770f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.811833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91384e-f724-46aa-96f5-51a7afc8a7a9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.812116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c602bf5-7e75-4e5f-aba7-428fba770f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.812423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c602bf5-7e75-4e5f-aba7-428fba770f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.812699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c602bf5-7e75-4e5f-aba7-428fba770f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.813434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c602bf5-7e75-4e5f-aba7-428fba770f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.815041 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c602bf5-7e75-4e5f-aba7-428fba770f6e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.816529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650623f-9a84-4d85-9d6b-01fe52d64389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.817173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650623f-9a84-4d85-9d6b-01fe52d64389 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.817446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650623f-9a84-4d85-9d6b-01fe52d64389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.817713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650623f-9a84-4d85-9d6b-01fe52d64389 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.818398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650623f-9a84-4d85-9d6b-01fe52d64389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.820309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650623f-9a84-4d85-9d6b-01fe52d64389 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.825817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 798/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:25.826578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c602bf5-7e75-4e5f-aba7-428fba770f6e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.839742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c602bf5-7e75-4e5f-aba7-428fba770f6e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.844965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 800/1598] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.844965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650623f-9a84-4d85-9d6b-01fe52d64389 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.845176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020640a3-eb4b-495a-a342-75463b49eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.845306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020640a3-eb4b-495a-a342-75463b49eccf admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.845631 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020640a3-eb4b-495a-a342-75463b49eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.846107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020640a3-eb4b-495a-a342-75463b49eccf admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.846810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020640a3-eb4b-495a-a342-75463b49eccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.848807 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020640a3-eb4b-495a-a342-75463b49eccf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.852980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650623f-9a84-4d85-9d6b-01fe52d64389 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.857435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e5d18-c671-4509-8935-11cf5a3ca354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.858418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e5d18-c671-4509-8935-11cf5a3ca354 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.858748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e5d18-c671-4509-8935-11cf5a3ca354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.858955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e5d18-c671-4509-8935-11cf5a3ca354 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.859780 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e5d18-c671-4509-8935-11cf5a3ca354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.861935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e5d18-c671-4509-8935-11cf5a3ca354 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.874331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 799/1599] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.874331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020640a3-eb4b-495a-a342-75463b49eccf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.882431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020640a3-eb4b-495a-a342-75463b49eccf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.887486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add61392-650a-4d5e-a4c6-9205e7aca345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.887660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 801/1600] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:25.891833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e5d18-c671-4509-8935-11cf5a3ca354 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.891982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add61392-650a-4d5e-a4c6-9205e7aca345 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.891982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add61392-650a-4d5e-a4c6-9205e7aca345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.891982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add61392-650a-4d5e-a4c6-9205e7aca345 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.891982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add61392-650a-4d5e-a4c6-9205e7aca345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.892541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add61392-650a-4d5e-a4c6-9205e7aca345 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.906209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 800/1601] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:25.906209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a32737-f30d-43b8-a33a-49f5da5be75f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.906209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a32737-f30d-43b8-a33a-49f5da5be75f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.906209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a32737-f30d-43b8-a33a-49f5da5be75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.923672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-41a32737-f30d-43b8-a33a-49f5da5be75f None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:25.924918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-41a32737-f30d-43b8-a33a-49f5da5be75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:25.947188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e5d18-c671-4509-8935-11cf5a3ca354 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.952176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc25803-5d71-4ed2-9afc-cbef3264619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.952877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc25803-5d71-4ed2-9afc-cbef3264619a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.953159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc25803-5d71-4ed2-9afc-cbef3264619a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.953433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc25803-5d71-4ed2-9afc-cbef3264619a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.954165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc25803-5d71-4ed2-9afc-cbef3264619a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.955771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc25803-5d71-4ed2-9afc-cbef3264619a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.966156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 802/1602] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:25.966800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc25803-5d71-4ed2-9afc-cbef3264619a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.976679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc25803-5d71-4ed2-9afc-cbef3264619a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:25.981364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b656a9-e08c-46bc-9c3a-7e5798251814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:25.982067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b656a9-e08c-46bc-9c3a-7e5798251814 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:25.982421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b656a9-e08c-46bc-9c3a-7e5798251814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:25.982766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b656a9-e08c-46bc-9c3a-7e5798251814 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:25.983564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b656a9-e08c-46bc-9c3a-7e5798251814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:25.985751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b656a9-e08c-46bc-9c3a-7e5798251814 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:25.992731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 801/1603] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Feb 7 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:25.993598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a32737-f30d-43b8-a33a-49f5da5be75f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:25.995622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 803/1604] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:25.996285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b656a9-e08c-46bc-9c3a-7e5798251814 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.006478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b656a9-e08c-46bc-9c3a-7e5798251814 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.006980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a32737-f30d-43b8-a33a-49f5da5be75f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.010767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b127-835b-465b-b08a-234a8f2debb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.011400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b127-835b-465b-b08a-234a8f2debb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.011595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac6ce6-515f-4ee6-8b24-8ad6082e1bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.011755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b127-835b-465b-b08a-234a8f2debb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.011940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b127-835b-465b-b08a-234a8f2debb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.012246 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac6ce6-515f-4ee6-8b24-8ad6082e1bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.012558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac6ce6-515f-4ee6-8b24-8ad6082e1bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.012676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5b127-835b-465b-b08a-234a8f2debb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.012831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac6ce6-515f-4ee6-8b24-8ad6082e1bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.013563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac6ce6-515f-4ee6-8b24-8ad6082e1bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.014253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5b127-835b-465b-b08a-234a8f2debb7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.015130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac6ce6-515f-4ee6-8b24-8ad6082e1bc8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.025457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 802/1605] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:26.028756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 804/1606] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:26.028868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac6ce6-515f-4ee6-8b24-8ad6082e1bc8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.028971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b127-835b-465b-b08a-234a8f2debb7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.035814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac6ce6-515f-4ee6-8b24-8ad6082e1bc8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.038333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b127-835b-465b-b08a-234a8f2debb7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.040478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c2cb-3381-4f87-978c-55059101cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.041114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c2cb-3381-4f87-978c-55059101cc1c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.041395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c2cb-3381-4f87-978c-55059101cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.041669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3c2cb-3381-4f87-978c-55059101cc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.042386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3c2cb-3381-4f87-978c-55059101cc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.042780 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b7fc2-31ae-41c7-9e74-28da3d3b8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.043411 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b7fc2-31ae-41c7-9e74-28da3d3b8212 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.043687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b7fc2-31ae-41c7-9e74-28da3d3b8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.043956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b7fc2-31ae-41c7-9e74-28da3d3b8212 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.044065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3c2cb-3381-4f87-978c-55059101cc1c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.044670 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b7fc2-31ae-41c7-9e74-28da3d3b8212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.046580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b7fc2-31ae-41c7-9e74-28da3d3b8212 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.053808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 803/1607] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:26.054953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c2cb-3381-4f87-978c-55059101cc1c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.066071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3c2cb-3381-4f87-978c-55059101cc1c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.067134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 805/1608] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:26 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:26.068313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b7fc2-31ae-41c7-9e74-28da3d3b8212 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.074742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0abb7-94cb-4df6-a93d-de27e7402c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.075662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0abb7-94cb-4df6-a93d-de27e7402c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.075948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0abb7-94cb-4df6-a93d-de27e7402c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.076220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0abb7-94cb-4df6-a93d-de27e7402c73 admin admin] PATH_INFO: `/v3/projects/8eff6e04661341908c55f615610f0336/users/99d300d31242482da2e6a956f37a98c6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.077683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b7fc2-31ae-41c7-9e74-28da3d3b8212 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.082283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e36ac-2347-42b7-9f3b-e1f172f02901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.082915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e36ac-2347-42b7-9f3b-e1f172f02901 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.083196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e36ac-2347-42b7-9f3b-e1f172f02901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.084021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e36ac-2347-42b7-9f3b-e1f172f02901 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.084784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e36ac-2347-42b7-9f3b-e1f172f02901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.086374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e36ac-2347-42b7-9f3b-e1f172f02901 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.091391 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0abb7-94cb-4df6-a93d-de27e7402c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eff6e04661341908c55f615610f0336, user_id=99d300d31242482da2e6a956f37a98c6, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.094420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0abb7-94cb-4df6-a93d-de27e7402c73 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.096958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 806/1609] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:26.097751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e36ac-2347-42b7-9f3b-e1f172f02901 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.107369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e36ac-2347-42b7-9f3b-e1f172f02901 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.111291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 804/1610] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:26 2022] PUT /identity/v3/projects/8eff6e04661341908c55f615610f0336/users/99d300d31242482da2e6a956f37a98c6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:26.111291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0abb7-94cb-4df6-a93d-de27e7402c73 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.163689 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55f9f0-db7c-45eb-981e-8c5e99cdfff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.164372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55f9f0-db7c-45eb-981e-8c5e99cdfff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.164676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55f9f0-db7c-45eb-981e-8c5e99cdfff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.164952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55f9f0-db7c-45eb-981e-8c5e99cdfff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.165679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55f9f0-db7c-45eb-981e-8c5e99cdfff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.167268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55f9f0-db7c-45eb-981e-8c5e99cdfff7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.176703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 807/1611] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:26.177518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55f9f0-db7c-45eb-981e-8c5e99cdfff7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.178462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0abb7-94cb-4df6-a93d-de27e7402c73 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.184708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b69021-6e71-45c9-9957-9ef89b74f957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.185378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b69021-6e71-45c9-9957-9ef89b74f957 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.185659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b69021-6e71-45c9-9957-9ef89b74f957 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.185928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b69021-6e71-45c9-9957-9ef89b74f957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.186896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55f9f0-db7c-45eb-981e-8c5e99cdfff7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.191397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efcfa2-f829-461c-90ee-e025c7ec5d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.192020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efcfa2-f829-461c-90ee-e025c7ec5d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.192299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efcfa2-f829-461c-90ee-e025c7ec5d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.193132 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efcfa2-f829-461c-90ee-e025c7ec5d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.193847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efcfa2-f829-461c-90ee-e025c7ec5d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.195411 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efcfa2-f829-461c-90ee-e025c7ec5d0c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.205181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 808/1612] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:26.206953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efcfa2-f829-461c-90ee-e025c7ec5d0c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.216822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efcfa2-f829-461c-90ee-e025c7ec5d0c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.221305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa058891-2ba2-49a3-92b9-0cd663b9e8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.222156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa058891-2ba2-49a3-92b9-0cd663b9e8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.222433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa058891-2ba2-49a3-92b9-0cd663b9e8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.222707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa058891-2ba2-49a3-92b9-0cd663b9e8b8 admin admin] PATH_INFO: `/v3/projects/b420d6a75bee4f108d3d5e3723db3f97/users/4197ebc1386c48e99fc150f70a1f8537/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.236755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa058891-2ba2-49a3-92b9-0cd663b9e8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b420d6a75bee4f108d3d5e3723db3f97, user_id=4197ebc1386c48e99fc150f70a1f8537, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.239363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa058891-2ba2-49a3-92b9-0cd663b9e8b8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.240888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b69021-6e71-45c9-9957-9ef89b74f957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.242529 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b69021-6e71-45c9-9957-9ef89b74f957 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.251481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 805/1613] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:26.252435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b69021-6e71-45c9-9957-9ef89b74f957 service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.257097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 809/1614] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:26 2022] PUT /identity/v3/projects/b420d6a75bee4f108d3d5e3723db3f97/users/4197ebc1386c48e99fc150f70a1f8537/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:26.257097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa058891-2ba2-49a3-92b9-0cd663b9e8b8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.262644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b69021-6e71-45c9-9957-9ef89b74f957 service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.318573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f25d7-e27c-4ebb-ac24-037167ea9b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.319232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f25d7-e27c-4ebb-ac24-037167ea9b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.319505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f25d7-e27c-4ebb-ac24-037167ea9b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.319773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f25d7-e27c-4ebb-ac24-037167ea9b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.320502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa058891-2ba2-49a3-92b9-0cd663b9e8b8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.320664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f25d7-e27c-4ebb-ac24-037167ea9b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.322485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f25d7-e27c-4ebb-ac24-037167ea9b1b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.325545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbdcd8-55b9-482c-a578-7b20412f81b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.326272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbdcd8-55b9-482c-a578-7b20412f81b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.326635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbdcd8-55b9-482c-a578-7b20412f81b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.326973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbdcd8-55b9-482c-a578-7b20412f81b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.327769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbdcd8-55b9-482c-a578-7b20412f81b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.329538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbdcd8-55b9-482c-a578-7b20412f81b9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.336414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 806/1615] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:26.336414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f25d7-e27c-4ebb-ac24-037167ea9b1b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.340327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 810/1616] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:26.344651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608e323-1543-444e-bd19-262f1a5e68cf None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.344942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608e323-1543-444e-bd19-262f1a5e68cf None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.345223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608e323-1543-444e-bd19-262f1a5e68cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.345602 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f25d7-e27c-4ebb-ac24-037167ea9b1b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.350241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c71fdd-0b6c-4740-9d70-d40f579ba9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.351131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c71fdd-0b6c-4740-9d70-d40f579ba9ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.351409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c71fdd-0b6c-4740-9d70-d40f579ba9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.351685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c71fdd-0b6c-4740-9d70-d40f579ba9ce admin admin] PATH_INFO: `/v3/projects/ea62fa68252a4419b7f8fe2873512277/users/4a6e100dfcd5498fa5e2a5a1b04429dd/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.362188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4608e323-1543-444e-bd19-262f1a5e68cf None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:26.363381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4608e323-1543-444e-bd19-262f1a5e68cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:26.366383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c71fdd-0b6c-4740-9d70-d40f579ba9ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea62fa68252a4419b7f8fe2873512277, user_id=4a6e100dfcd5498fa5e2a5a1b04429dd, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.369071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c71fdd-0b6c-4740-9d70-d40f579ba9ce admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.371752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 811/1617] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:26.372509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608e323-1543-444e-bd19-262f1a5e68cf None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.383424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608e323-1543-444e-bd19-262f1a5e68cf None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.389044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 807/1618] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:26 2022] PUT /identity/v3/projects/ea62fa68252a4419b7f8fe2873512277/users/4a6e100dfcd5498fa5e2a5a1b04429dd/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:26.393658 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c71fdd-0b6c-4740-9d70-d40f579ba9ce admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.441992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4152a6-9d65-4f85-92c1-f9c76824bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.443534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4152a6-9d65-4f85-92c1-f9c76824bdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.443814 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4152a6-9d65-4f85-92c1-f9c76824bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.444091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4152a6-9d65-4f85-92c1-f9c76824bdfd admin admin] PATH_INFO: `/v3/projects/6c48105a4eb44b7a8fea1f2e7b101b12/users/773468f9056641feb625017550906cf6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.454866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c71fdd-0b6c-4740-9d70-d40f579ba9ce admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.458607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4152a6-9d65-4f85-92c1-f9c76824bdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c48105a4eb44b7a8fea1f2e7b101b12, user_id=773468f9056641feb625017550906cf6, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.459704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e56141-8f49-4a87-87f5-1fc4448ba83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.460759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e56141-8f49-4a87-87f5-1fc4448ba83b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.461131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e56141-8f49-4a87-87f5-1fc4448ba83b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.461277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4152a6-9d65-4f85-92c1-f9c76824bdfd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.461574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e56141-8f49-4a87-87f5-1fc4448ba83b admin admin] PATH_INFO: `/v3/projects/199396bfc5a94bf9bc3a62d3f1edcffe/users/6a6283063de943d5aaa9cccce65525da/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.474545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 812/1619] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:26 2022] PUT /identity/v3/projects/6c48105a4eb44b7a8fea1f2e7b101b12/users/773468f9056641feb625017550906cf6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:26.476330 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e56141-8f49-4a87-87f5-1fc4448ba83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=199396bfc5a94bf9bc3a62d3f1edcffe, user_id=6a6283063de943d5aaa9cccce65525da, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.479195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e56141-8f49-4a87-87f5-1fc4448ba83b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.482426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65469920-d226-4275-a7b6-7ff67ed17301 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.483659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65469920-d226-4275-a7b6-7ff67ed17301 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.484370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65469920-d226-4275-a7b6-7ff67ed17301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.504805 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-65469920-d226-4275-a7b6-7ff67ed17301 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:26.506030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 808/1620] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:26 2022] PUT /identity/v3/projects/199396bfc5a94bf9bc3a62d3f1edcffe/users/6a6283063de943d5aaa9cccce65525da/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:26.506928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-65469920-d226-4275-a7b6-7ff67ed17301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:26.513423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e56141-8f49-4a87-87f5-1fc4448ba83b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.571155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 813/1621] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:26.572206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65469920-d226-4275-a7b6-7ff67ed17301 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.581865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65469920-d226-4275-a7b6-7ff67ed17301 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.586441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cd915-2555-429f-8bf9-e992301cbf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.587080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cd915-2555-429f-8bf9-e992301cbf9b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.587362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cd915-2555-429f-8bf9-e992301cbf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.587637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cd915-2555-429f-8bf9-e992301cbf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.588389 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cd915-2555-429f-8bf9-e992301cbf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.589639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e56141-8f49-4a87-87f5-1fc4448ba83b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.590129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cd915-2555-429f-8bf9-e992301cbf9b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.594282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920e1f9-f4b6-4fbe-a366-c45efacbb100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.595163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920e1f9-f4b6-4fbe-a366-c45efacbb100 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.595444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920e1f9-f4b6-4fbe-a366-c45efacbb100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.595720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920e1f9-f4b6-4fbe-a366-c45efacbb100 admin admin] PATH_INFO: `/v3/projects/a49aa1fab0e34cf8b10b7d216d642828/users/96cb52955ccd402f91bb0c3c982ae6e6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.599918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 814/1622] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:26.600784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cd915-2555-429f-8bf9-e992301cbf9b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.610343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920e1f9-f4b6-4fbe-a366-c45efacbb100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a49aa1fab0e34cf8b10b7d216d642828, user_id=96cb52955ccd402f91bb0c3c982ae6e6, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.613018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920e1f9-f4b6-4fbe-a366-c45efacbb100 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.627241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 809/1623] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:26 2022] PUT /identity/v3/projects/a49aa1fab0e34cf8b10b7d216d642828/users/96cb52955ccd402f91bb0c3c982ae6e6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:26.628570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3612d-3f31-4e51-9de4-a5c4d8acbe8f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.628856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3612d-3f31-4e51-9de4-a5c4d8acbe8f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.629129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3612d-3f31-4e51-9de4-a5c4d8acbe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.646701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-71b3612d-3f31-4e51-9de4-a5c4d8acbe8f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:26.647874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-71b3612d-3f31-4e51-9de4-a5c4d8acbe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:26.656494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cd915-2555-429f-8bf9-e992301cbf9b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.704274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cd3c3-5ffe-42bd-b6b7-d3fb269b0d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.708143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cd3c3-5ffe-42bd-b6b7-d3fb269b0d05 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.708305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 810/1624] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:26.708459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cd3c3-5ffe-42bd-b6b7-d3fb269b0d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.708459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cd3c3-5ffe-42bd-b6b7-d3fb269b0d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.708634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1cc33-db20-4324-8489-49195bbaf12a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.708634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1cc33-db20-4324-8489-49195bbaf12a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.708634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1cc33-db20-4324-8489-49195bbaf12a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.709264 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 811/1625] 10.222.0.15 () {54 vars in 912 bytes} [Mon Feb 7 02:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:40:26.710246 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080831-3006-406f-89b0-a57399f1beea None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.710593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080831-3006-406f-89b0-a57399f1beea None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.710874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080831-3006-406f-89b0-a57399f1beea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.723330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cd3c3-5ffe-42bd-b6b7-d3fb269b0d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.725334 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cd3c3-5ffe-42bd-b6b7-d3fb269b0d05 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.738231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 815/1626] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:26.738731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b8080831-3006-406f-89b0-a57399f1beea None None] MFA Rules not processed for user `773468f9056641feb625017550906cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:26.740236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60c32-dc41-4789-ae9f-13567b99ae5e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.740566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60c32-dc41-4789-ae9f-13567b99ae5e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.740699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b8080831-3006-406f-89b0-a57399f1beea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:26.740843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b60c32-dc41-4789-ae9f-13567b99ae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.772620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-11b60c32-dc41-4789-ae9f-13567b99ae5e None None] MFA Rules not processed for user `6a6283063de943d5aaa9cccce65525da`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:26.773940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-11b60c32-dc41-4789-ae9f-13567b99ae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:26.818994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 812/1627] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:26.818994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8080831-3006-406f-89b0-a57399f1beea None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.828129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8080831-3006-406f-89b0-a57399f1beea None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.832697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca0df0-8468-4877-8f80-52eb1ed2ee37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.833404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca0df0-8468-4877-8f80-52eb1ed2ee37 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.833678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca0df0-8468-4877-8f80-52eb1ed2ee37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.834071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca0df0-8468-4877-8f80-52eb1ed2ee37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.844541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca0df0-8468-4877-8f80-52eb1ed2ee37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.849931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca0df0-8468-4877-8f80-52eb1ed2ee37 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.850069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 816/1628] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:26.850069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b60c32-dc41-4789-ae9f-13567b99ae5e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.857423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 813/1629] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:26.857606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b60c32-dc41-4789-ae9f-13567b99ae5e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.859078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c6616-5a6d-4b7f-85be-7c8815b6f8a5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.859368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c6616-5a6d-4b7f-85be-7c8815b6f8a5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.859750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c6616-5a6d-4b7f-85be-7c8815b6f8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.862287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d252d45-e720-4a54-b3fb-71bc9f6a4e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:26.863225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d252d45-e720-4a54-b3fb-71bc9f6a4e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.863505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d252d45-e720-4a54-b3fb-71bc9f6a4e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.863965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d252d45-e720-4a54-b3fb-71bc9f6a4e7f admin admin] PATH_INFO: `/v3/projects/bc58f921c7904541a4117c979384bfab/users/febd2890142148ce85064c3bc8a4c532/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.879539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-193c6616-5a6d-4b7f-85be-7c8815b6f8a5 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:26.880944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-193c6616-5a6d-4b7f-85be-7c8815b6f8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:26.882888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d252d45-e720-4a54-b3fb-71bc9f6a4e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc58f921c7904541a4117c979384bfab, user_id=febd2890142148ce85064c3bc8a4c532, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:26.887110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d252d45-e720-4a54-b3fb-71bc9f6a4e7f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:26.890185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 814/1630] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:26.893244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c6616-5a6d-4b7f-85be-7c8815b6f8a5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:26.907147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 817/1631] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:26 2022] PUT /identity/v3/projects/bc58f921c7904541a4117c979384bfab/users/febd2890142148ce85064c3bc8a4c532/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:26.908480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d4625-055c-4207-a5d8-0f5e460deba6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:26.908991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d4625-055c-4207-a5d8-0f5e460deba6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:26.909376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d4625-055c-4207-a5d8-0f5e460deba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:26.914807 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c6616-5a6d-4b7f-85be-7c8815b6f8a5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:26.936652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4e8d4625-055c-4207-a5d8-0f5e460deba6 None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:26.936652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4e8d4625-055c-4207-a5d8-0f5e460deba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:27.002397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13aaee-a952-4b33-bc7d-ea55436b3f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.002986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13aaee-a952-4b33-bc7d-ea55436b3f3d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.003313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13aaee-a952-4b33-bc7d-ea55436b3f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.003644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13aaee-a952-4b33-bc7d-ea55436b3f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.058915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 818/1632] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:40:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:27.061033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d4625-055c-4207-a5d8-0f5e460deba6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.092287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13aaee-a952-4b33-bc7d-ea55436b3f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.095324 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13aaee-a952-4b33-bc7d-ea55436b3f3d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.113634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 815/1633] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:27.115148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13aaee-a952-4b33-bc7d-ea55436b3f3d service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.126273 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13aaee-a952-4b33-bc7d-ea55436b3f3d service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.133850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079e10f-5f1c-4958-9e9a-e0ab2a3998ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.134651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079e10f-5f1c-4958-9e9a-e0ab2a3998ae admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.135005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079e10f-5f1c-4958-9e9a-e0ab2a3998ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.135379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079e10f-5f1c-4958-9e9a-e0ab2a3998ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.136210 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079e10f-5f1c-4958-9e9a-e0ab2a3998ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.138876 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079e10f-5f1c-4958-9e9a-e0ab2a3998ae admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.176409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 816/1634] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:27 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:27.177374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079e10f-5f1c-4958-9e9a-e0ab2a3998ae admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.197466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8d4625-055c-4207-a5d8-0f5e460deba6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.241784 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079e10f-5f1c-4958-9e9a-e0ab2a3998ae admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.246601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602769d-0c8c-4fb2-b9f8-760874640fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.247906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602769d-0c8c-4fb2-b9f8-760874640fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.248220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602769d-0c8c-4fb2-b9f8-760874640fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.248726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602769d-0c8c-4fb2-b9f8-760874640fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.285590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20251453-55c5-4382-9257-c3f8c2d6be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.288048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20251453-55c5-4382-9257-c3f8c2d6be7b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.288592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20251453-55c5-4382-9257-c3f8c2d6be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.289561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20251453-55c5-4382-9257-c3f8c2d6be7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.290573 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20251453-55c5-4382-9257-c3f8c2d6be7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.293775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20251453-55c5-4382-9257-c3f8c2d6be7b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.332863 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 819/1635] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:27 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:27.337993 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0fcb-55ee-4649-a31e-22d5b401ae17 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.338370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0fcb-55ee-4649-a31e-22d5b401ae17 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.338843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0fcb-55ee-4649-a31e-22d5b401ae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.342767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602769d-0c8c-4fb2-b9f8-760874640fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.344263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602769d-0c8c-4fb2-b9f8-760874640fa5 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.356639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 817/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:27.357489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602769d-0c8c-4fb2-b9f8-760874640fa5 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.369788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-802a0fcb-55ee-4649-a31e-22d5b401ae17 None None] MFA Rules not processed for user `febd2890142148ce85064c3bc8a4c532`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:27.371102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-802a0fcb-55ee-4649-a31e-22d5b401ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:27.435394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602769d-0c8c-4fb2-b9f8-760874640fa5 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.449689 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 820/1637] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:27.450582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a0fcb-55ee-4649-a31e-22d5b401ae17 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.513526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9c7eb-4e27-47bc-8e04-80473628f817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.514395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9c7eb-4e27-47bc-8e04-80473628f817 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.514690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9c7eb-4e27-47bc-8e04-80473628f817 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.516247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9c7eb-4e27-47bc-8e04-80473628f817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.577336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a0fcb-55ee-4649-a31e-22d5b401ae17 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.593689 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99ab42-1f19-432e-9122-6bc793f3b2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.595150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ab42-1f19-432e-9122-6bc793f3b2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.595277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ab42-1f19-432e-9122-6bc793f3b2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.595480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99ab42-1f19-432e-9122-6bc793f3b2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.596887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99ab42-1f19-432e-9122-6bc793f3b2b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.602728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c99ab42-1f19-432e-9122-6bc793f3b2b2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.621362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9c7eb-4e27-47bc-8e04-80473628f817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.627874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9c7eb-4e27-47bc-8e04-80473628f817 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.643371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 818/1638] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:27.644301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9c7eb-4e27-47bc-8e04-80473628f817 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.655792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9c7eb-4e27-47bc-8e04-80473628f817 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.668695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 821/1639] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:27 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:27.668695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb14c-9a8c-4cfa-83a7-64add23b2db1 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.668695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb14c-9a8c-4cfa-83a7-64add23b2db1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.668695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb14c-9a8c-4cfa-83a7-64add23b2db1 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.669702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 822/1640] 10.222.0.15 () {54 vars in 961 bytes} [Mon Feb 7 02:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:40:27.670353 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bb14c-9a8c-4cfa-83a7-64add23b2db1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.677158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1497f-b514-43c1-b0e9-6db2d1e283c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.677848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1497f-b514-43c1-b0e9-6db2d1e283c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.678347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1497f-b514-43c1-b0e9-6db2d1e283c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.678591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1497f-b514-43c1-b0e9-6db2d1e283c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.679801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1497f-b514-43c1-b0e9-6db2d1e283c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.681344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1497f-b514-43c1-b0e9-6db2d1e283c7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.709441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bb14c-9a8c-4cfa-83a7-64add23b2db1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.715145 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 819/1641] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:27 2022] POST /identity/v3/users => generated 300 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:27.718440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87b44a-72c3-4a8c-ad4e-dff3ca342143 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.718923 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87b44a-72c3-4a8c-ad4e-dff3ca342143 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.719371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87b44a-72c3-4a8c-ad4e-dff3ca342143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.722510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1b655-7f15-431b-aa02-72bf5b01bbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.725020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1b655-7f15-431b-aa02-72bf5b01bbaa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.725523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1b655-7f15-431b-aa02-72bf5b01bbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.725867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1b655-7f15-431b-aa02-72bf5b01bbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.727516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1b655-7f15-431b-aa02-72bf5b01bbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.729419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1b655-7f15-431b-aa02-72bf5b01bbaa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.764328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3d87b44a-72c3-4a8c-ad4e-dff3ca342143 None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:27.765779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3d87b44a-72c3-4a8c-ad4e-dff3ca342143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:27.765909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 823/1642] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:27.767087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1b655-7f15-431b-aa02-72bf5b01bbaa admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.785789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 820/1643] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Feb 7 02:40:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:27.786678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87b44a-72c3-4a8c-ad4e-dff3ca342143 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.796317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1b655-7f15-431b-aa02-72bf5b01bbaa admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.809147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87b44a-72c3-4a8c-ad4e-dff3ca342143 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.810037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38008235-8e53-4d68-b55f-25d1e9e50a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.810843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38008235-8e53-4d68-b55f-25d1e9e50a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.811239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38008235-8e53-4d68-b55f-25d1e9e50a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.811632 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38008235-8e53-4d68-b55f-25d1e9e50a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.812565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38008235-8e53-4d68-b55f-25d1e9e50a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.814438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38008235-8e53-4d68-b55f-25d1e9e50a54 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.817197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0b8a-d17f-4444-9e3e-42cd05f47b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.818645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0b8a-d17f-4444-9e3e-42cd05f47b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.818922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0b8a-d17f-4444-9e3e-42cd05f47b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.819190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0b8a-d17f-4444-9e3e-42cd05f47b2f admin admin] PATH_INFO: `/v3/projects/39608f5c83a44114be0f311f65b18b4e/users/e6fe002dcb3f4a189d3bce5ac871891a/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.843922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 824/1644] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:27.843922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38008235-8e53-4d68-b55f-25d1e9e50a54 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.857328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0b8a-d17f-4444-9e3e-42cd05f47b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39608f5c83a44114be0f311f65b18b4e, user_id=e6fe002dcb3f4a189d3bce5ac871891a, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.860079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0b8a-d17f-4444-9e3e-42cd05f47b2f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.869493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38008235-8e53-4d68-b55f-25d1e9e50a54 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:27.886039 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad6661-75b1-4cd4-afd0-869633073929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:27.886953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6661-75b1-4cd4-afd0-869633073929 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:27.887343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6661-75b1-4cd4-afd0-869633073929 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:27.887825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad6661-75b1-4cd4-afd0-869633073929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:27.888933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 821/1645] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:27 2022] PUT /identity/v3/projects/39608f5c83a44114be0f311f65b18b4e/users/e6fe002dcb3f4a189d3bce5ac871891a/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:27.889737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0b8a-d17f-4444-9e3e-42cd05f47b2f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.912289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad6661-75b1-4cd4-afd0-869633073929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:27.914254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad6661-75b1-4cd4-afd0-869633073929 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:27.933918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 825/1646] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:27.945412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad6661-75b1-4cd4-afd0-869633073929 service nova] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:27.981080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad6661-75b1-4cd4-afd0-869633073929 service nova] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:28.042129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0b8a-d17f-4444-9e3e-42cd05f47b2f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:28.068925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3a654-d2a4-49e5-8ce0-6e690f3dc991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:28.069719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3a654-d2a4-49e5-8ce0-6e690f3dc991 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.069979 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3a654-d2a4-49e5-8ce0-6e690f3dc991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.070394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3a654-d2a4-49e5-8ce0-6e690f3dc991 admin admin] PATH_INFO: `/v3/projects/86bc5aded06f410b8917636b66c14845/users/0d23b3d4f78747a6b28374735969adff/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.119605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3a654-d2a4-49e5-8ce0-6e690f3dc991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bc5aded06f410b8917636b66c14845, user_id=0d23b3d4f78747a6b28374735969adff, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:28.122685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3a654-d2a4-49e5-8ce0-6e690f3dc991 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:28.161374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 822/1647] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:27 2022] PUT /identity/v3/projects/86bc5aded06f410b8917636b66c14845/users/0d23b3d4f78747a6b28374735969adff/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:28.161582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc082e-5241-4dea-89f2-57bbfee05182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:28.161582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc082e-5241-4dea-89f2-57bbfee05182 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.161816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfe8c6-4bc0-4d69-bb18-f00268d435cb None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.161914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc082e-5241-4dea-89f2-57bbfee05182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.162002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfe8c6-4bc0-4d69-bb18-f00268d435cb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.162090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc082e-5241-4dea-89f2-57bbfee05182 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.162202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfe8c6-4bc0-4d69-bb18-f00268d435cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.162291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc082e-5241-4dea-89f2-57bbfee05182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:28.163070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc082e-5241-4dea-89f2-57bbfee05182 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:28.187439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 826/1648] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:28.189036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc082e-5241-4dea-89f2-57bbfee05182 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:28.212163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc082e-5241-4dea-89f2-57bbfee05182 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:28.252466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-68cfe8c6-4bc0-4d69-bb18-f00268d435cb None None] MFA Rules not processed for user `99d300d31242482da2e6a956f37a98c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:28.258328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-68cfe8c6-4bc0-4d69-bb18-f00268d435cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:28.341786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00407c-8838-4e1f-a705-5789d9489649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:28.342467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00407c-8838-4e1f-a705-5789d9489649 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.342744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00407c-8838-4e1f-a705-5789d9489649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.343018 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00407c-8838-4e1f-a705-5789d9489649 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.344421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00407c-8838-4e1f-a705-5789d9489649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:28.346110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00407c-8838-4e1f-a705-5789d9489649 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:28.378611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 827/1649] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:28.378611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00407c-8838-4e1f-a705-5789d9489649 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:28.396456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00407c-8838-4e1f-a705-5789d9489649 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:28.401388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225abd8f-d3f1-43ee-8400-bc890845dad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:28.402281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225abd8f-d3f1-43ee-8400-bc890845dad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.402558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225abd8f-d3f1-43ee-8400-bc890845dad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.402829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225abd8f-d3f1-43ee-8400-bc890845dad9 admin admin] PATH_INFO: `/v3/projects/39608f5c83a44114be0f311f65b18b4e/users/e6fe002dcb3f4a189d3bce5ac871891a/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.405068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225abd8f-d3f1-43ee-8400-bc890845dad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39608f5c83a44114be0f311f65b18b4e, user_id=e6fe002dcb3f4a189d3bce5ac871891a, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:28.407700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225abd8f-d3f1-43ee-8400-bc890845dad9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:28.432667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 828/1650] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:28 2022] PUT /identity/v3/projects/39608f5c83a44114be0f311f65b18b4e/users/e6fe002dcb3f4a189d3bce5ac871891a/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:28.433967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225abd8f-d3f1-43ee-8400-bc890845dad9 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:28.488805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 823/1651] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:28.500097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd2b28-231a-4ac0-b3ce-cf48c4e3bb2f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.500097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd2b28-231a-4ac0-b3ce-cf48c4e3bb2f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.506079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd2b28-231a-4ac0-b3ce-cf48c4e3bb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.608884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3cfd2b28-231a-4ac0-b3ce-cf48c4e3bb2f None None] MFA Rules not processed for user `e6fe002dcb3f4a189d3bce5ac871891a`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:28.610446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3cfd2b28-231a-4ac0-b3ce-cf48c4e3bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:28.678147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225abd8f-d3f1-43ee-8400-bc890845dad9 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:28.689757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8df8e-89b3-4b00-88f8-43d21716748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:28.692836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8df8e-89b3-4b00-88f8-43d21716748d admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.693196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8df8e-89b3-4b00-88f8-43d21716748d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.694874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8df8e-89b3-4b00-88f8-43d21716748d admin admin] PATH_INFO: `/v3/projects/86bc5aded06f410b8917636b66c14845/users/0d23b3d4f78747a6b28374735969adff/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.703385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8df8e-89b3-4b00-88f8-43d21716748d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bc5aded06f410b8917636b66c14845, user_id=0d23b3d4f78747a6b28374735969adff, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:28.710955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8df8e-89b3-4b00-88f8-43d21716748d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:28.730221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 824/1652] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:28.734655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c7a2-93d4-463d-89f9-f94bfcb2a5b0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.734956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c7a2-93d4-463d-89f9-f94bfcb2a5b0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.735239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c7a2-93d4-463d-89f9-f94bfcb2a5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.754506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 829/1653] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:28 2022] PUT /identity/v3/projects/86bc5aded06f410b8917636b66c14845/users/0d23b3d4f78747a6b28374735969adff/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:28.756273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966cdc9-4f68-4bea-8d5d-e56f87b11a1b None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.756619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966cdc9-4f68-4bea-8d5d-e56f87b11a1b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.756901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966cdc9-4f68-4bea-8d5d-e56f87b11a1b None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.762972 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 830/1654] 10.222.0.15 () {54 vars in 912 bytes} [Mon Feb 7 02:40:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:40:28.763844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966cdc9-4f68-4bea-8d5d-e56f87b11a1b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:28.780999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3c31c7a2-93d4-463d-89f9-f94bfcb2a5b0 None None] MFA Rules not processed for user `99d300d31242482da2e6a956f37a98c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:28.782448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3c31c7a2-93d4-463d-89f9-f94bfcb2a5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:28.850800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 825/1655] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:28.852250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93f9b-5078-427e-b43c-06aeae16dc13 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.852581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93f9b-5078-427e-b43c-06aeae16dc13 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.852859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d93f9b-5078-427e-b43c-06aeae16dc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:28.882862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-11d93f9b-5078-427e-b43c-06aeae16dc13 None None] MFA Rules not processed for user `0d23b3d4f78747a6b28374735969adff`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:28.883995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-11d93f9b-5078-427e-b43c-06aeae16dc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:28.899115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966cdc9-4f68-4bea-8d5d-e56f87b11a1b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:28.917899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72a443-2526-4e30-a3c7-39a54c80b762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:28.919158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72a443-2526-4e30-a3c7-39a54c80b762 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:28.920453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72a443-2526-4e30-a3c7-39a54c80b762 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:28.921133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72a443-2526-4e30-a3c7-39a54c80b762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:29.024887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 826/1656] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:29.027901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89086e9e-dc41-473d-8d73-6bb45daf5035 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:29.029306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89086e9e-dc41-473d-8d73-6bb45daf5035 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:29.029816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89086e9e-dc41-473d-8d73-6bb45daf5035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:29.036310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72a443-2526-4e30-a3c7-39a54c80b762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:29.039009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72a443-2526-4e30-a3c7-39a54c80b762 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:29.082786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-89086e9e-dc41-473d-8d73-6bb45daf5035 None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:29.084642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 831/1657] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:29.087499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72a443-2526-4e30-a3c7-39a54c80b762 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:29.087699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-89086e9e-dc41-473d-8d73-6bb45daf5035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:29.242055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 827/1658] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:40:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:29.243488 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89086e9e-dc41-473d-8d73-6bb45daf5035 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:29.264319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89086e9e-dc41-473d-8d73-6bb45daf5035 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:29.274810 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72a443-2526-4e30-a3c7-39a54c80b762 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:29.278933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283895b3-b82f-4943-a2de-bdbebb2d40c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:29.280305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283895b3-b82f-4943-a2de-bdbebb2d40c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:29.280686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283895b3-b82f-4943-a2de-bdbebb2d40c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:29.283008 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc56c4-98d1-473c-89af-242ae58b6fe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:29.283259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283895b3-b82f-4943-a2de-bdbebb2d40c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:29.284091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc56c4-98d1-473c-89af-242ae58b6fe0 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:29.284898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc56c4-98d1-473c-89af-242ae58b6fe0 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:29.285438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc56c4-98d1-473c-89af-242ae58b6fe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:29.301670 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc56c4-98d1-473c-89af-242ae58b6fe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:29.306897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc56c4-98d1-473c-89af-242ae58b6fe0 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:29.310006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283895b3-b82f-4943-a2de-bdbebb2d40c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:29.311478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283895b3-b82f-4943-a2de-bdbebb2d40c3 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:29.333744 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 828/1659] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:29.334464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 832/1660] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:29.334598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283895b3-b82f-4943-a2de-bdbebb2d40c3 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:29.352792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283895b3-b82f-4943-a2de-bdbebb2d40c3 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:29.365970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acc801-f9c9-406f-b629-965d3e59be71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:29.366441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc56c4-98d1-473c-89af-242ae58b6fe0 service nova] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:29.366652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acc801-f9c9-406f-b629-965d3e59be71 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:29.366923 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acc801-f9c9-406f-b629-965d3e59be71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:29.367200 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acc801-f9c9-406f-b629-965d3e59be71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:29.380001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc56c4-98d1-473c-89af-242ae58b6fe0 service nova] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:29.390249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acc801-f9c9-406f-b629-965d3e59be71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:29.396785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fd754-28f6-4c21-b276-a9534015cf5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:29.397442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fd754-28f6-4c21-b276-a9534015cf5a service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:29.397725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fd754-28f6-4c21-b276-a9534015cf5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:29.398004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fd754-28f6-4c21-b276-a9534015cf5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:29.399441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acc801-f9c9-406f-b629-965d3e59be71 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:29.415433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 829/1661] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:29.527123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fd754-28f6-4c21-b276-a9534015cf5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:29.528902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fd754-28f6-4c21-b276-a9534015cf5a service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:29.541986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 833/1662] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:40:29.961398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422eac3-68b0-4aed-a379-61c818919f77 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:29.961398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422eac3-68b0-4aed-a379-61c818919f77 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:29.961398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422eac3-68b0-4aed-a379-61c818919f77 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:29.961398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 830/1663] 10.222.0.15 () {54 vars in 912 bytes} [Mon Feb 7 02:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:40:29.966485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d34c-7dba-43e3-96fc-09c742a0e8aa None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:29.966987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d34c-7dba-43e3-96fc-09c742a0e8aa None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:29.967099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d34c-7dba-43e3-96fc-09c742a0e8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:30.106462 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bb83d34c-7dba-43e3-96fc-09c742a0e8aa None None] MFA Rules not processed for user `b3922641f7c846da98457824bec58652`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:30.107791 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bb83d34c-7dba-43e3-96fc-09c742a0e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:30.117710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422eac3-68b0-4aed-a379-61c818919f77 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:30.218608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 834/1664] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:40:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:40:30.244364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83d34c-7dba-43e3-96fc-09c742a0e8aa None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:30.260272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83d34c-7dba-43e3-96fc-09c742a0e8aa None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:30.267763 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d21a2-a7f4-4771-ad09-597ad92a1415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:30.273021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d21a2-a7f4-4771-ad09-597ad92a1415 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:30.273316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d21a2-a7f4-4771-ad09-597ad92a1415 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:30.278303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d21a2-a7f4-4771-ad09-597ad92a1415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:30.284311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422eac3-68b0-4aed-a379-61c818919f77 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:30.303966 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:30.308310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d21a2-a7f4-4771-ad09-597ad92a1415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:30.309446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:30.312338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:30.312773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] PATH_INFO: `/v3/users/773468f9056641feb625017550906cf6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:30.315003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d21a2-a7f4-4771-ad09-597ad92a1415 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:30.317067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773468f9056641feb625017550906cf6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:30.321343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:40:30.321343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 07 02:40:30.321343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: Feb 07 02:40:30.324620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:30.338200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 835/1665] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:30.503959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773468f9056641feb625017550906cf6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:30.543187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773468f9056641feb625017550906cf6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:30.597822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773468f9056641feb625017550906cf6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:30.599126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773468f9056641feb625017550906cf6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:30.618449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773468f9056641feb625017550906cf6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:30.631238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 831/1666] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:40:30 2022] DELETE /identity/v3/users/773468f9056641feb625017550906cf6 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:40:30.635372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ae72-ce77-4527-b82d-b2503d64802c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:30.636247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ae72-ce77-4527-b82d-b2503d64802c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:30.636583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ae72-ce77-4527-b82d-b2503d64802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:30.681889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fd90ae72-ce77-4527-b82d-b2503d64802c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:30.686211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fd90ae72-ce77-4527-b82d-b2503d64802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:30.800177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 836/1667] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:30.808024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:30.810043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:30.956224 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45037c-def8-488c-b56b-c6e6205eb706 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:30.976771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697e189-9df9-45d9-a7d6-e1b4a21d2898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:30.979600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697e189-9df9-45d9-a7d6-e1b4a21d2898 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:30.981309 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697e189-9df9-45d9-a7d6-e1b4a21d2898 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:30.982288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697e189-9df9-45d9-a7d6-e1b4a21d2898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:30.996461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697e189-9df9-45d9-a7d6-e1b4a21d2898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:30.999081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697e189-9df9-45d9-a7d6-e1b4a21d2898 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:31.018975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 832/1668] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:31.430151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ae72-ce77-4527-b82d-b2503d64802c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:31.432574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fd90ae72-ce77-4527-b82d-b2503d64802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:31.577337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ae72-ce77-4527-b82d-b2503d64802c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:31.585341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69241a45-49cf-4d53-bf1f-a23351ee9c00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06b37b8f23946ebbb5083a877274ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:31.586542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69241a45-49cf-4d53-bf1f-a23351ee9c00 service placement] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:31.586975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69241a45-49cf-4d53-bf1f-a23351ee9c00 service placement] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:31.587595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69241a45-49cf-4d53-bf1f-a23351ee9c00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:31.590638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-69241a45-49cf-4d53-bf1f-a23351ee9c00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:31.608638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69241a45-49cf-4d53-bf1f-a23351ee9c00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:31.610787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69241a45-49cf-4d53-bf1f-a23351ee9c00 service placement] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:31.636128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 837/1669] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:32.305988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697e189-9df9-45d9-a7d6-e1b4a21d2898 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:32.308322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4697e189-9df9-45d9-a7d6-e1b4a21d2898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:32.332286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697e189-9df9-45d9-a7d6-e1b4a21d2898 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:32.350960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:32.351930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:32.352216 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:32.352515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] PATH_INFO: `/v3/projects/6c48105a4eb44b7a8fea1f2e7b101b12` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:32.354315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c48105a4eb44b7a8fea1f2e7b101b12)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:32.357777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:32.502837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c48105a4eb44b7a8fea1f2e7b101b12', 'request_id': 'req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:32.538333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c48105a4eb44b7a8fea1f2e7b101b12', 'request_id': 'req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:32.553106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c48105a4eb44b7a8fea1f2e7b101b12', 'request_id': 'req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:32.587991 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] The token cache is being invalidate because project 6c48105a4eb44b7a8fea1f2e7b101b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:40:32.588288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:32.592681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:32.597136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 833/1670] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:40:32 2022] DELETE /identity/v3/projects/6c48105a4eb44b7a8fea1f2e7b101b12 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:32.600947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69241a45-49cf-4d53-bf1f-a23351ee9c00 service placement] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:32.618179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69241a45-49cf-4d53-bf1f-a23351ee9c00 service placement] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:32.788767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:32.789754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:32.791168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:32.791624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] PATH_INFO: `/v3/users/0d23b3d4f78747a6b28374735969adff` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:32.793407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d23b3d4f78747a6b28374735969adff)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:32.798455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:32.942398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d23b3d4f78747a6b28374735969adff'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:32.963363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d23b3d4f78747a6b28374735969adff'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:33.001338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d23b3d4f78747a6b28374735969adff'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:33.027611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d23b3d4f78747a6b28374735969adff'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:33.027929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d23b3d4f78747a6b28374735969adff'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:33.044299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 838/1671] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:40:32 2022] DELETE /identity/v3/users/0d23b3d4f78747a6b28374735969adff => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:34.634951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:34.636547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:34.668492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ae2e8-e6f4-4b78-9126-97b8de02bf58 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:34.804806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:34.805680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:34.805963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:34.806231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] PATH_INFO: `/v3/projects/86bc5aded06f410b8917636b66c14845` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:34.808724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=86bc5aded06f410b8917636b66c14845)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:34.810716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:34.912257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86bc5aded06f410b8917636b66c14845', 'request_id': 'req-5c639ab9-9372-4efa-ab7a-dc51c64056ef'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:34.925754 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86bc5aded06f410b8917636b66c14845', 'request_id': 'req-5c639ab9-9372-4efa-ab7a-dc51c64056ef'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:34.940690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86bc5aded06f410b8917636b66c14845', 'request_id': 'req-5c639ab9-9372-4efa-ab7a-dc51c64056ef'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:34.944989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:34.948697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:34.966963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de635-02c9-4513-83c2-64a110bd57bf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:34.979674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] The token cache is being invalidate because project 86bc5aded06f410b8917636b66c14845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:40:34.979962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:34.982492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5c639ab9-9372-4efa-ab7a-dc51c64056ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:34.984701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 834/1672] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:40:34 2022] DELETE /identity/v3/projects/86bc5aded06f410b8917636b66c14845 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:34.990496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f074f-e035-4aa5-9541-e96f4d138ef9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:34.991012 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f074f-e035-4aa5-9541-e96f4d138ef9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:34.992396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f074f-e035-4aa5-9541-e96f4d138ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.035840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-021f074f-e035-4aa5-9541-e96f4d138ef9 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:35.037223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-021f074f-e035-4aa5-9541-e96f4d138ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:35.062419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:35.063610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.064047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.064523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] PATH_INFO: `/v3/users/febd2890142148ce85064c3bc8a4c532` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.066147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] RBAC: Authorizing `identity:delete_user(user_id=febd2890142148ce85064c3bc8a4c532)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:35.068928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:35.150219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febd2890142148ce85064c3bc8a4c532'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:35.165784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febd2890142148ce85064c3bc8a4c532'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:35.166187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 835/1673] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:35.175537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee5d84-e290-43a8-8588-657fb54d2b84 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.176147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee5d84-e290-43a8-8588-657fb54d2b84 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.176968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee5d84-e290-43a8-8588-657fb54d2b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.181679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febd2890142148ce85064c3bc8a4c532'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:35.209179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febd2890142148ce85064c3bc8a4c532'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:35.210220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-aba5e7b1-924b-4f11-b5f8-96d83a2f957a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febd2890142148ce85064c3bc8a4c532'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:35.223028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 839/1674] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:40:34 2022] DELETE /identity/v3/users/febd2890142148ce85064c3bc8a4c532 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:40:35.226084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5dee5d84-e290-43a8-8588-657fb54d2b84 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:35.227468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2dde2-d10c-4a9d-9630-52730a66792a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.227924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2dde2-d10c-4a9d-9630-52730a66792a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.228381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2dde2-d10c-4a9d-9630-52730a66792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.229207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5dee5d84-e290-43a8-8588-657fb54d2b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:35.265020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-35a2dde2-d10c-4a9d-9630-52730a66792a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:35.266512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-35a2dde2-d10c-4a9d-9630-52730a66792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:35.393352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 840/1675] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:35.424653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 836/1676] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:40:35.430023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2dde2-d10c-4a9d-9630-52730a66792a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:35.443540 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee5d84-e290-43a8-8588-657fb54d2b84 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:35.444958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2dde2-d10c-4a9d-9630-52730a66792a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:35.446149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5dee5d84-e290-43a8-8588-657fb54d2b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:35.463281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc32a6-f3ac-45b0-bf13-384cf15ab901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:35.463980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc32a6-f3ac-45b0-bf13-384cf15ab901 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.464248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc32a6-f3ac-45b0-bf13-384cf15ab901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.469017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc32a6-f3ac-45b0-bf13-384cf15ab901 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.470789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc32a6-f3ac-45b0-bf13-384cf15ab901 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:35.471168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc32a6-f3ac-45b0-bf13-384cf15ab901 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:35.477771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc32a6-f3ac-45b0-bf13-384cf15ab901 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:35.525941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 841/1677] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:35.527369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc32a6-f3ac-45b0-bf13-384cf15ab901 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:35.563980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc32a6-f3ac-45b0-bf13-384cf15ab901 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:35.566566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee5d84-e290-43a8-8588-657fb54d2b84 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:35.576320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447f4e8-8957-4a99-ba3d-3baa86b3a556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:35.577182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447f4e8-8957-4a99-ba3d-3baa86b3a556 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.580278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447f4e8-8957-4a99-ba3d-3baa86b3a556 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.580484 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37bb0d-b59c-477c-bbf4-c419fbdb66b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:35.581194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37bb0d-b59c-477c-bbf4-c419fbdb66b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.581556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37bb0d-b59c-477c-bbf4-c419fbdb66b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.581754 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447f4e8-8957-4a99-ba3d-3baa86b3a556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.582877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37bb0d-b59c-477c-bbf4-c419fbdb66b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.585821 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37bb0d-b59c-477c-bbf4-c419fbdb66b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:35.590125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37bb0d-b59c-477c-bbf4-c419fbdb66b1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:35.608921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447f4e8-8957-4a99-ba3d-3baa86b3a556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:35.610406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447f4e8-8957-4a99-ba3d-3baa86b3a556 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:35.630549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 837/1678] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:40:35.666347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 842/1679] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:35 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:35.671454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447f4e8-8957-4a99-ba3d-3baa86b3a556 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:35.687533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447f4e8-8957-4a99-ba3d-3baa86b3a556 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:35.752757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9172-0699-4f55-8f53-67f580c98731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:35.753779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9172-0699-4f55-8f53-67f580c98731 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.754214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9172-0699-4f55-8f53-67f580c98731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.754785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9172-0699-4f55-8f53-67f580c98731 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.755664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9172-0699-4f55-8f53-67f580c98731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:35.758103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9172-0699-4f55-8f53-67f580c98731 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:35.795874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 838/1680] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:35 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:35.799985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37bb0d-b59c-477c-bbf4-c419fbdb66b1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:35.819559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37bb0d-b59c-477c-bbf4-c419fbdb66b1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:35.838735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c3f0f-13c1-4b80-ab47-506ad5eb2949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:35.839855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3f0f-13c1-4b80-ab47-506ad5eb2949 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.840362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3f0f-13c1-4b80-ab47-506ad5eb2949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.840850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3f0f-13c1-4b80-ab47-506ad5eb2949 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.841802 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c3f0f-13c1-4b80-ab47-506ad5eb2949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:35.845078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c3f0f-13c1-4b80-ab47-506ad5eb2949 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:35.892489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 843/1681] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:35.897109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9172-0699-4f55-8f53-67f580c98731 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:35.908625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9172-0699-4f55-8f53-67f580c98731 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:35.924656 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a63335-2a67-42ef-b9ff-42d87d1dd604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:35.925626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a63335-2a67-42ef-b9ff-42d87d1dd604 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.926112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a63335-2a67-42ef-b9ff-42d87d1dd604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.926551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a63335-2a67-42ef-b9ff-42d87d1dd604 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.928243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a63335-2a67-42ef-b9ff-42d87d1dd604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:35.931627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a63335-2a67-42ef-b9ff-42d87d1dd604 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:35.953957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c3f0f-13c1-4b80-ab47-506ad5eb2949 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:35.962312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 839/1682] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:35.965673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c3f0f-13c1-4b80-ab47-506ad5eb2949 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:35.971098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f7aee-3852-4ed0-aa6c-f01817ac86a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:35.972206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f7aee-3852-4ed0-aa6c-f01817ac86a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:35.972688 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f7aee-3852-4ed0-aa6c-f01817ac86a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:35.973343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f7aee-3852-4ed0-aa6c-f01817ac86a2 admin admin] PATH_INFO: `/v3/projects/2ff988d3f58745d181ffb3be9e95c0dc/users/5100fd1cc2d044e5839aa504bb287584/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:35.999723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f7aee-3852-4ed0-aa6c-f01817ac86a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff988d3f58745d181ffb3be9e95c0dc, user_id=5100fd1cc2d044e5839aa504bb287584, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:36.003440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f7aee-3852-4ed0-aa6c-f01817ac86a2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:36.041474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 844/1683] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:35 2022] PUT /identity/v3/projects/2ff988d3f58745d181ffb3be9e95c0dc/users/5100fd1cc2d044e5839aa504bb287584/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:36.051948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228b12-d9cb-450a-a366-478cce28d124 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:36.052213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228b12-d9cb-450a-a366-478cce28d124 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:36.053243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228b12-d9cb-450a-a366-478cce28d124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:36.107765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ff228b12-d9cb-450a-a366-478cce28d124 None None] MFA Rules not processed for user `5100fd1cc2d044e5839aa504bb287584`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:36.109450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ff228b12-d9cb-450a-a366-478cce28d124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:36.252051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 840/1684] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:36.258438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f7aee-3852-4ed0-aa6c-f01817ac86a2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:36.445961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f7aee-3852-4ed0-aa6c-f01817ac86a2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:36.457076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326b552-71ac-4dcd-aed8-da94fc9186b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:36.458041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326b552-71ac-4dcd-aed8-da94fc9186b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:36.458473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326b552-71ac-4dcd-aed8-da94fc9186b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:36.458916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326b552-71ac-4dcd-aed8-da94fc9186b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:36.459786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326b552-71ac-4dcd-aed8-da94fc9186b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:36.462690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326b552-71ac-4dcd-aed8-da94fc9186b3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:36.525621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 845/1685] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:36 2022] POST /identity/v3/projects => generated 367 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:36.533560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228b12-d9cb-450a-a366-478cce28d124 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:36.549564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff228b12-d9cb-450a-a366-478cce28d124 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:36.675833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec03b-25aa-4696-8af6-d5ace6860ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:36.677895 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec03b-25aa-4696-8af6-d5ace6860ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:36.678288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec03b-25aa-4696-8af6-d5ace6860ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:36.679279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec03b-25aa-4696-8af6-d5ace6860ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:36.685709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ec03b-25aa-4696-8af6-d5ace6860ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:36.688562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ec03b-25aa-4696-8af6-d5ace6860ba8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:36.763700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 841/1686] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:36 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:36.764604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326b552-71ac-4dcd-aed8-da94fc9186b3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:36.775804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326b552-71ac-4dcd-aed8-da94fc9186b3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:36.790217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac13f41-3659-40f0-a900-ec6829a8e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:36.791732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac13f41-3659-40f0-a900-ec6829a8e7ff admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:36.792216 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac13f41-3659-40f0-a900-ec6829a8e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:36.792707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac13f41-3659-40f0-a900-ec6829a8e7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:36.793662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac13f41-3659-40f0-a900-ec6829a8e7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:36.795543 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac13f41-3659-40f0-a900-ec6829a8e7ff admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:36.820273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 846/1687] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:36.824764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec03b-25aa-4696-8af6-d5ace6860ba8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:36.841329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec03b-25aa-4696-8af6-d5ace6860ba8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:36.863492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48606d-6245-4407-8909-bb85c4a89734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:36.865017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48606d-6245-4407-8909-bb85c4a89734 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:36.865294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48606d-6245-4407-8909-bb85c4a89734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:36.865573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48606d-6245-4407-8909-bb85c4a89734 admin admin] PATH_INFO: `/v3/projects/84a6c36ad0cc4a84b124c03e36488836/users/957ac57958fd4c6d82bff1f969ea5a55/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:36.960947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48606d-6245-4407-8909-bb85c4a89734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a6c36ad0cc4a84b124c03e36488836, user_id=957ac57958fd4c6d82bff1f969ea5a55, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:36.964292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48606d-6245-4407-8909-bb85c4a89734 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:36.991174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 842/1688] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:36 2022] PUT /identity/v3/projects/84a6c36ad0cc4a84b124c03e36488836/users/957ac57958fd4c6d82bff1f969ea5a55/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:36.994848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac13f41-3659-40f0-a900-ec6829a8e7ff admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:37.023967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac13f41-3659-40f0-a900-ec6829a8e7ff admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:37.174338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334b251-2d3c-425b-a2e4-804cea7acb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:37.174338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334b251-2d3c-425b-a2e4-804cea7acb1b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.174338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334b251-2d3c-425b-a2e4-804cea7acb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:37.174338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334b251-2d3c-425b-a2e4-804cea7acb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:37.175296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334b251-2d3c-425b-a2e4-804cea7acb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:37.175296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334b251-2d3c-425b-a2e4-804cea7acb1b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:37.175706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48606d-6245-4407-8909-bb85c4a89734 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:37.175706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7d48606d-6245-4407-8909-bb85c4a89734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:37.176023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 847/1689] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:37.180237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334b251-2d3c-425b-a2e4-804cea7acb1b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:37.191158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48606d-6245-4407-8909-bb85c4a89734 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:37.193314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334b251-2d3c-425b-a2e4-804cea7acb1b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:37.199709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee1346-e47c-4273-94f2-5e9203d27ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:37.200986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1346-e47c-4273-94f2-5e9203d27ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.201405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1346-e47c-4273-94f2-5e9203d27ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:37.201841 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1346-e47c-4273-94f2-5e9203d27ddf admin admin] PATH_INFO: `/v3/projects/84a6c36ad0cc4a84b124c03e36488836/users/957ac57958fd4c6d82bff1f969ea5a55/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:37.205060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee1346-e47c-4273-94f2-5e9203d27ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a6c36ad0cc4a84b124c03e36488836, user_id=957ac57958fd4c6d82bff1f969ea5a55, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:37.214513 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:37.216815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.217094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:37.217829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] PATH_INFO: `/v3/projects/bc58f921c7904541a4117c979384bfab` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:37.230063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc58f921c7904541a4117c979384bfab)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:37.232099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee1346-e47c-4273-94f2-5e9203d27ddf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:37.249654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 848/1690] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:37 2022] PUT /identity/v3/projects/84a6c36ad0cc4a84b124c03e36488836/users/957ac57958fd4c6d82bff1f969ea5a55/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:37.256497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:37.266803 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166642-51e0-4c43-911c-8fcb40ef8f67 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.267099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166642-51e0-4c43-911c-8fcb40ef8f67 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:37.267380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166642-51e0-4c43-911c-8fcb40ef8f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:37.349643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4b166642-51e0-4c43-911c-8fcb40ef8f67 None None] MFA Rules not processed for user `957ac57958fd4c6d82bff1f969ea5a55`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:37.353643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4b166642-51e0-4c43-911c-8fcb40ef8f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:37.386298 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc58f921c7904541a4117c979384bfab', 'request_id': 'req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:37.404636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc58f921c7904541a4117c979384bfab', 'request_id': 'req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:37.420932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc58f921c7904541a4117c979384bfab', 'request_id': 'req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:37.453644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] The token cache is being invalidate because project bc58f921c7904541a4117c979384bfab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:40:37.454717 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:37.455653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b3ef8721-e07b-4c6b-86b8-2d7ee0ebfe0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:37.459487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 843/1691] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:40:37 2022] DELETE /identity/v3/projects/bc58f921c7904541a4117c979384bfab => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:40:37.466000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3b671-931f-4101-b149-f4b4790fb398 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.466841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3b671-931f-4101-b149-f4b4790fb398 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:37.467290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3b671-931f-4101-b149-f4b4790fb398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:37.509860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-28f3b671-931f-4101-b149-f4b4790fb398 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:37.514956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-28f3b671-931f-4101-b149-f4b4790fb398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:37.525586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 849/1692] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:37.535534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b166642-51e0-4c43-911c-8fcb40ef8f67 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:37.539247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4b166642-51e0-4c43-911c-8fcb40ef8f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:37.701515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 844/1693] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:40:37.702850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06283342-fca9-4e34-921f-8bcb0fe78f9c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.703139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06283342-fca9-4e34-921f-8bcb0fe78f9c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:37.703416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06283342-fca9-4e34-921f-8bcb0fe78f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:37.720053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b166642-51e0-4c43-911c-8fcb40ef8f67 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:37.727531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abad22-78da-4521-9bcc-5a25233c3c98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:37.728215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abad22-78da-4521-9bcc-5a25233c3c98 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.728540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abad22-78da-4521-9bcc-5a25233c3c98 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:37.728819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abad22-78da-4521-9bcc-5a25233c3c98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:37.741159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abad22-78da-4521-9bcc-5a25233c3c98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:37.744194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abad22-78da-4521-9bcc-5a25233c3c98 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:37.745883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-06283342-fca9-4e34-921f-8bcb0fe78f9c None None] MFA Rules not processed for user `4197ebc1386c48e99fc150f70a1f8537`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:37.747788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-06283342-fca9-4e34-921f-8bcb0fe78f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:37.757802 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 850/1694] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:37.771850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0245b5-85cd-4873-b10f-b9b78d4cc7bd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.772161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0245b5-85cd-4873-b10f-b9b78d4cc7bd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:37.772431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0245b5-85cd-4873-b10f-b9b78d4cc7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:37.859329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 845/1695] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:37.863868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64447e-a290-47e3-9688-470d50fd7fe7 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.866950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64447e-a290-47e3-9688-470d50fd7fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:37.868696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64447e-a290-47e3-9688-470d50fd7fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:37.872164 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5b0245b5-85cd-4873-b10f-b9b78d4cc7bd None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:37.873722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5b0245b5-85cd-4873-b10f-b9b78d4cc7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:37.904316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 851/1696] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:37.920503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0245b5-85cd-4873-b10f-b9b78d4cc7bd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:37.929024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1e64447e-a290-47e3-9688-470d50fd7fe7 None None] MFA Rules not processed for user `4197ebc1386c48e99fc150f70a1f8537`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:37.936868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1e64447e-a290-47e3-9688-470d50fd7fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:37.963212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 846/1697] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:37.970244 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0245b5-85cd-4873-b10f-b9b78d4cc7bd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:37.977817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64447e-a290-47e3-9688-470d50fd7fe7 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:37.980851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1e64447e-a290-47e3-9688-470d50fd7fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:37.997046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:37.998554 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:37.999076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:38.001216 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:38.004587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:38.006304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:38.010335 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:38.051115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 852/1698] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:38.052433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:38.060972 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:38.104891 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3e582-8c25-4d2d-810f-9a9c59bcfd0f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:38.127777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f78a9d-cf32-4713-b1e2-fb2c3c5cb520 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:38.130273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f78a9d-cf32-4713-b1e2-fb2c3c5cb520 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:38.131046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f78a9d-cf32-4713-b1e2-fb2c3c5cb520 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:38.132176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f78a9d-cf32-4713-b1e2-fb2c3c5cb520 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:38.152680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-78f78a9d-cf32-4713-b1e2-fb2c3c5cb520 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:38.201387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64447e-a290-47e3-9688-470d50fd7fe7 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:38.226290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994cdab-8785-48c5-889c-35491aac773a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:38.230158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994cdab-8785-48c5-889c-35491aac773a service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:38.230440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994cdab-8785-48c5-889c-35491aac773a service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:38.230710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994cdab-8785-48c5-889c-35491aac773a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:38.287769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994cdab-8785-48c5-889c-35491aac773a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:38.293231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994cdab-8785-48c5-889c-35491aac773a service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:38.329227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 847/1699] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:40:38.330109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994cdab-8785-48c5-889c-35491aac773a service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:38.366254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994cdab-8785-48c5-889c-35491aac773a service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:38.393889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5ffc5-2f3c-4ebf-92d5-5fe4a8157f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:38.398011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ffc5-2f3c-4ebf-92d5-5fe4a8157f9e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:38.398011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ffc5-2f3c-4ebf-92d5-5fe4a8157f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:38.398011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ffc5-2f3c-4ebf-92d5-5fe4a8157f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:38.398011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5ffc5-2f3c-4ebf-92d5-5fe4a8157f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:38.437296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f78a9d-cf32-4713-b1e2-fb2c3c5cb520 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:38.439543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5ffc5-2f3c-4ebf-92d5-5fe4a8157f9e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:38.444511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f78a9d-cf32-4713-b1e2-fb2c3c5cb520 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:38.496305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 853/1700] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:38.498246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b69cf4-9b47-4165-99a9-177c0c7e2206 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:38.498246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b69cf4-9b47-4165-99a9-177c0c7e2206 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:38.498369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b69cf4-9b47-4165-99a9-177c0c7e2206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:38.570691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 848/1701] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:38 2022] POST /identity/v3/projects => generated 367 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:38.575673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5ffc5-2f3c-4ebf-92d5-5fe4a8157f9e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:38.585509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-69b69cf4-9b47-4165-99a9-177c0c7e2206 None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:38.588142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-69b69cf4-9b47-4165-99a9-177c0c7e2206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:38.812013 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 854/1702] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:40:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:38.918215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5ffc5-2f3c-4ebf-92d5-5fe4a8157f9e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:38.937689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9950-5003-4820-92e3-97113662ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:38.938438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9950-5003-4820-92e3-97113662ea56 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:38.938740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9950-5003-4820-92e3-97113662ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:38.938982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9950-5003-4820-92e3-97113662ea56 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:38.939694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9950-5003-4820-92e3-97113662ea56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:38.942098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9950-5003-4820-92e3-97113662ea56 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:38.973646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 849/1703] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:38 2022] POST /identity/v3/users => generated 284 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:38.974730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b69cf4-9b47-4165-99a9-177c0c7e2206 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:38.988868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b69cf4-9b47-4165-99a9-177c0c7e2206 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:38.995772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32171fa3-3113-4c4e-9dc0-7bc3bbb35f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:38.996668 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32171fa3-3113-4c4e-9dc0-7bc3bbb35f45 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:38.997141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32171fa3-3113-4c4e-9dc0-7bc3bbb35f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:38.997668 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32171fa3-3113-4c4e-9dc0-7bc3bbb35f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:38.998569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32171fa3-3113-4c4e-9dc0-7bc3bbb35f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:39.000774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32171fa3-3113-4c4e-9dc0-7bc3bbb35f45 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:39.016238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 855/1704] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:40:39.022129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9950-5003-4820-92e3-97113662ea56 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:39.038411 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9950-5003-4820-92e3-97113662ea56 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:39.050171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6ca5-e0e7-46bf-a699-d2e5db94bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:39.052264 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6ca5-e0e7-46bf-a699-d2e5db94bb39 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:39.052605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6ca5-e0e7-46bf-a699-d2e5db94bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:39.053139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6ca5-e0e7-46bf-a699-d2e5db94bb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:39.057445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6ca5-e0e7-46bf-a699-d2e5db94bb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:39.059321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6ca5-e0e7-46bf-a699-d2e5db94bb39 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:39.081543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 850/1705] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:40:39.083594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32171fa3-3113-4c4e-9dc0-7bc3bbb35f45 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:39.102337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32171fa3-3113-4c4e-9dc0-7bc3bbb35f45 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:39.125069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59514cdf-c4fb-49f2-b80a-01bd77c74145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:39.128174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59514cdf-c4fb-49f2-b80a-01bd77c74145 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:39.128492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59514cdf-c4fb-49f2-b80a-01bd77c74145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:39.128772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59514cdf-c4fb-49f2-b80a-01bd77c74145 admin admin] PATH_INFO: `/v3/projects/b623384d789047ce8e06dfad60065439/users/591c7e5da2e04b039c66da959b11dd9c/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:39.167438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59514cdf-c4fb-49f2-b80a-01bd77c74145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b623384d789047ce8e06dfad60065439, user_id=591c7e5da2e04b039c66da959b11dd9c, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:39.183239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59514cdf-c4fb-49f2-b80a-01bd77c74145 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:39.209733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6ca5-e0e7-46bf-a699-d2e5db94bb39 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:39.212918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dcaa6ca5-e0e7-46bf-a699-d2e5db94bb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:39.236134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 856/1706] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:39 2022] PUT /identity/v3/projects/b623384d789047ce8e06dfad60065439/users/591c7e5da2e04b039c66da959b11dd9c/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:39.242436 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f4c0-f39d-4cd0-a2b8-bb60cdb5b894 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:39.242723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f4c0-f39d-4cd0-a2b8-bb60cdb5b894 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:39.242997 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f4c0-f39d-4cd0-a2b8-bb60cdb5b894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:39.298759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9c11f4c0-f39d-4cd0-a2b8-bb60cdb5b894 None None] MFA Rules not processed for user `591c7e5da2e04b039c66da959b11dd9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:39.302728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9c11f4c0-f39d-4cd0-a2b8-bb60cdb5b894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:39.413597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6ca5-e0e7-46bf-a699-d2e5db94bb39 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:39.571939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 857/1707] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:39.577186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f4c0-f39d-4cd0-a2b8-bb60cdb5b894 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:39.583891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ec01e-6593-402c-8697-13f4a3b4ce27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:39.584906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ec01e-6593-402c-8697-13f4a3b4ce27 service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:39.585200 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ec01e-6593-402c-8697-13f4a3b4ce27 service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:39.585478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ec01e-6593-402c-8697-13f4a3b4ce27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:39.822445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f4c0-f39d-4cd0-a2b8-bb60cdb5b894 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:39.828909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ec01e-6593-402c-8697-13f4a3b4ce27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:39.832397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ec01e-6593-402c-8697-13f4a3b4ce27 service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:39.853052 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc1ee2-fda2-4f57-8044-74a0a607aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:39.853735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc1ee2-fda2-4f57-8044-74a0a607aa61 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:39.854067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc1ee2-fda2-4f57-8044-74a0a607aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:39.854315 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc1ee2-fda2-4f57-8044-74a0a607aa61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:39.855015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc1ee2-fda2-4f57-8044-74a0a607aa61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:39.857913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc1ee2-fda2-4f57-8044-74a0a607aa61 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:39.862066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 851/1708] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:40:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 02:40:39.987519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ec01e-6593-402c-8697-13f4a3b4ce27 service swift] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:39.988061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 858/1709] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:39 2022] POST /identity/v3/projects => generated 367 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:40.044069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ec01e-6593-402c-8697-13f4a3b4ce27 service swift] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:40.241663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc1ee2-fda2-4f57-8044-74a0a607aa61 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:40.243428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9ecc1ee2-fda2-4f57-8044-74a0a607aa61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:40.281903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d8ca9-9e4a-4eca-98d5-274d187931c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:40.282595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d8ca9-9e4a-4eca-98d5-274d187931c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:40.282880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d8ca9-9e4a-4eca-98d5-274d187931c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:40.283232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d8ca9-9e4a-4eca-98d5-274d187931c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:40.283944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d8ca9-9e4a-4eca-98d5-274d187931c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:40.290194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d8ca9-9e4a-4eca-98d5-274d187931c0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:40.354173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 852/1710] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:39 2022] POST /identity/v3/users => generated 290 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:40.368742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c55855-2e11-417b-9147-ad5ef68d0106 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:40.370846 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c55855-2e11-417b-9147-ad5ef68d0106 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:40.371345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c55855-2e11-417b-9147-ad5ef68d0106 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:40.374411 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 853/1711] 10.222.0.15 () {54 vars in 912 bytes} [Mon Feb 7 02:40:40 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:40:40.381323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c55855-2e11-417b-9147-ad5ef68d0106 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:40.434260 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c55855-2e11-417b-9147-ad5ef68d0106 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:40.467528 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff752b4c-9b29-4de3-8ae6-8fb405f38921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:40.468295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff752b4c-9b29-4de3-8ae6-8fb405f38921 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:40.468535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff752b4c-9b29-4de3-8ae6-8fb405f38921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:40.468811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff752b4c-9b29-4de3-8ae6-8fb405f38921 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:40.469578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff752b4c-9b29-4de3-8ae6-8fb405f38921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:40.471222 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff752b4c-9b29-4de3-8ae6-8fb405f38921 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:40.577419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 854/1712] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:40.585358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55775cd4-045d-4996-bbd1-acc84d745859 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:40.585809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55775cd4-045d-4996-bbd1-acc84d745859 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:40.589518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55775cd4-045d-4996-bbd1-acc84d745859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:40.642622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc1ee2-fda2-4f57-8044-74a0a607aa61 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:40.666167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:40.667061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:40.667350 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:40.667613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] PATH_INFO: `/v3/users/1615be81905a4e67ac3b34ab9f913b4d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:40.680040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1615be81905a4e67ac3b34ab9f913b4d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:40.683071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-55775cd4-045d-4996-bbd1-acc84d745859 None None] MFA Rules not processed for user `b3922641f7c846da98457824bec58652`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:40.684218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-55775cd4-045d-4996-bbd1-acc84d745859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:40.687338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:40.850676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1615be81905a4e67ac3b34ab9f913b4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:40.866724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1615be81905a4e67ac3b34ab9f913b4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:40.882857 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1615be81905a4e67ac3b34ab9f913b4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:40.895220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 855/1713] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:40:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:40.898657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55775cd4-045d-4996-bbd1-acc84d745859 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:40.908973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1615be81905a4e67ac3b34ab9f913b4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:40.910235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ed56341-e89e-4a45-a86b-6517f6bfa1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1615be81905a4e67ac3b34ab9f913b4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:40.925691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 859/1714] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:40:40 2022] DELETE /identity/v3/users/1615be81905a4e67ac3b34ab9f913b4d => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:40.929921 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a88ea-faf8-4d6e-8a26-27306f116dee None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:40.930211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a88ea-faf8-4d6e-8a26-27306f116dee None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:40.930490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a88ea-faf8-4d6e-8a26-27306f116dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:40.943702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55775cd4-045d-4996-bbd1-acc84d745859 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:41.038200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-af9a88ea-faf8-4d6e-8a26-27306f116dee None None] MFA Rules not processed for user `96cb52955ccd402f91bb0c3c982ae6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:41.046348 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-af9a88ea-faf8-4d6e-8a26-27306f116dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:41.178189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509425c-5795-4199-8a96-4051fdc8a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:41.179184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509425c-5795-4199-8a96-4051fdc8a45a admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:41.179496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509425c-5795-4199-8a96-4051fdc8a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:41.179784 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509425c-5795-4199-8a96-4051fdc8a45a admin admin] PATH_INFO: `/v3/projects/ce5f170a3bfa4e67a935d1e3c1f977fe/users/c541d1b0ca604f2bade2d4f15e1fa217/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:41.226079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509425c-5795-4199-8a96-4051fdc8a45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5f170a3bfa4e67a935d1e3c1f977fe, user_id=c541d1b0ca604f2bade2d4f15e1fa217, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:41.229363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509425c-5795-4199-8a96-4051fdc8a45a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:41.267469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 856/1715] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:40 2022] PUT /identity/v3/projects/ce5f170a3bfa4e67a935d1e3c1f977fe/users/c541d1b0ca604f2bade2d4f15e1fa217/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:41.276464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f55df5-adf7-4eaa-9785-746254fe358d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:41.277171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f55df5-adf7-4eaa-9785-746254fe358d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:41.277636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f55df5-adf7-4eaa-9785-746254fe358d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:41.352870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-31f55df5-adf7-4eaa-9785-746254fe358d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:41.356925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 860/1716] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:41.359168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-31f55df5-adf7-4eaa-9785-746254fe358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:41.361645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a88ea-faf8-4d6e-8a26-27306f116dee None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:41.371463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-af9a88ea-faf8-4d6e-8a26-27306f116dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:41.577234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a88ea-faf8-4d6e-8a26-27306f116dee None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:41.623267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 857/1717] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:41.632483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f55df5-adf7-4eaa-9785-746254fe358d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:41.639256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-31f55df5-adf7-4eaa-9785-746254fe358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:41.680613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f55df5-adf7-4eaa-9785-746254fe358d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:41.704213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ba971-e689-42a6-8aec-402bf09ffd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:41.705349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ba971-e689-42a6-8aec-402bf09ffd35 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:41.705782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ba971-e689-42a6-8aec-402bf09ffd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:41.706062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ba971-e689-42a6-8aec-402bf09ffd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:41.706811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ba971-e689-42a6-8aec-402bf09ffd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:41.707472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c7b95-434b-43b9-9691-195c1821ac86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:41.708172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7b95-434b-43b9-9691-195c1821ac86 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:41.708589 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ba971-e689-42a6-8aec-402bf09ffd35 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:41.710112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7b95-434b-43b9-9691-195c1821ac86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:41.710405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c7b95-434b-43b9-9691-195c1821ac86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:41.714999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f99c7b95-434b-43b9-9691-195c1821ac86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:41.754180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7b95-434b-43b9-9691-195c1821ac86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:41.757610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c7b95-434b-43b9-9691-195c1821ac86 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:41.765036 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 858/1718] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:41.766053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ba971-e689-42a6-8aec-402bf09ffd35 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:41.771074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-011ba971-e689-42a6-8aec-402bf09ffd35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:41.783372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 861/1719] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:41.787040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b3a23-e778-42cc-bdc1-7c17c63806a3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:41.787345 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b3a23-e778-42cc-bdc1-7c17c63806a3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:41.787624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b3a23-e778-42cc-bdc1-7c17c63806a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:41.867206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-af1b3a23-e778-42cc-bdc1-7c17c63806a3 None None] MFA Rules not processed for user `4a6e100dfcd5498fa5e2a5a1b04429dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:41.869791 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-af1b3a23-e778-42cc-bdc1-7c17c63806a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:41.967774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ba971-e689-42a6-8aec-402bf09ffd35 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:41.996134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e1440-e4d9-46f5-9005-50bcb04c077e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:41.997025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e1440-e4d9-46f5-9005-50bcb04c077e service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:41.997562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e1440-e4d9-46f5-9005-50bcb04c077e service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:41.998005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e1440-e4d9-46f5-9005-50bcb04c077e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:42.037711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 862/1720] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:42.038588 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b3a23-e778-42cc-bdc1-7c17c63806a3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:42.040737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-af1b3a23-e778-42cc-bdc1-7c17c63806a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:42.059014 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b3a23-e778-42cc-bdc1-7c17c63806a3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:42.064332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c2022-529c-4bdd-b0d3-934eafe4395e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:42.076371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c2022-529c-4bdd-b0d3-934eafe4395e service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:42.076371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c2022-529c-4bdd-b0d3-934eafe4395e service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:42.076686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c2022-529c-4bdd-b0d3-934eafe4395e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:42.104474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c2022-529c-4bdd-b0d3-934eafe4395e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:42.107285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c2022-529c-4bdd-b0d3-934eafe4395e service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:42.124962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 863/1721] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:42.126734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c2022-529c-4bdd-b0d3-934eafe4395e service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:42.137332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c2022-529c-4bdd-b0d3-934eafe4395e service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:42.149556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15c073-ed27-4aec-999e-1b1f703f3786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:42.151351 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15c073-ed27-4aec-999e-1b1f703f3786 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:42.152778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15c073-ed27-4aec-999e-1b1f703f3786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:42.153385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15c073-ed27-4aec-999e-1b1f703f3786 admin admin] PATH_INFO: `/v3/projects/ce5f170a3bfa4e67a935d1e3c1f977fe/users/c541d1b0ca604f2bade2d4f15e1fa217/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:42.159695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15c073-ed27-4aec-999e-1b1f703f3786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5f170a3bfa4e67a935d1e3c1f977fe, user_id=c541d1b0ca604f2bade2d4f15e1fa217, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:42.164847 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e1440-e4d9-46f5-9005-50bcb04c077e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:42.165938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15c073-ed27-4aec-999e-1b1f703f3786 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:42.167015 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e1440-e4d9-46f5-9005-50bcb04c077e service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:42.197014 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 864/1722] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:42 2022] PUT /identity/v3/projects/ce5f170a3bfa4e67a935d1e3c1f977fe/users/c541d1b0ca604f2bade2d4f15e1fa217/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:42.209301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a77c1-ac13-4e47-9ee2-3c3034c2e0df None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:42.210318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a77c1-ac13-4e47-9ee2-3c3034c2e0df None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:42.210736 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a77c1-ac13-4e47-9ee2-3c3034c2e0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:42.225840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 859/1723] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:42.246256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02961222-05f3-4c82-bd24-301a665ec55d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:42.246466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02961222-05f3-4c82-bd24-301a665ec55d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:42.246789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02961222-05f3-4c82-bd24-301a665ec55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:42.284321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-02961222-05f3-4c82-bd24-301a665ec55d None None] MFA Rules not processed for user `b3922641f7c846da98457824bec58652`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:42.285719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-02961222-05f3-4c82-bd24-301a665ec55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:42.292789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0a3a77c1-ac13-4e47-9ee2-3c3034c2e0df None None] MFA Rules not processed for user `c541d1b0ca604f2bade2d4f15e1fa217`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:42.295157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0a3a77c1-ac13-4e47-9ee2-3c3034c2e0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:42.445325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 860/1724] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Feb 7 02:40:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:40:42.478514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02961222-05f3-4c82-bd24-301a665ec55d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:42.489873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02961222-05f3-4c82-bd24-301a665ec55d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:42.492693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 865/1725] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:40:42.504041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a77c1-ac13-4e47-9ee2-3c3034c2e0df None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:42.510089 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0a3a77c1-ac13-4e47-9ee2-3c3034c2e0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:42.511025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84032bc8-f990-4fc9-9a60-6fd64d4920c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:42.513843 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032bc8-f990-4fc9-9a60-6fd64d4920c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:42.514138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032bc8-f990-4fc9-9a60-6fd64d4920c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:42.514419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84032bc8-f990-4fc9-9a60-6fd64d4920c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:42.543952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84032bc8-f990-4fc9-9a60-6fd64d4920c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:42.548000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84032bc8-f990-4fc9-9a60-6fd64d4920c1 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:42.595235 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 861/1726] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:40:42.721604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a77c1-ac13-4e47-9ee2-3c3034c2e0df None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:42.732408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558834f-9579-41e9-9762-2a5008fe71ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:42.733011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558834f-9579-41e9-9762-2a5008fe71ce service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:42.733273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558834f-9579-41e9-9762-2a5008fe71ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:42.733552 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558834f-9579-41e9-9762-2a5008fe71ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:42.772938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558834f-9579-41e9-9762-2a5008fe71ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:42.774447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558834f-9579-41e9-9762-2a5008fe71ce service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:42.801983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 866/1727] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:42.969438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84032bc8-f990-4fc9-9a60-6fd64d4920c1 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:42.971322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-84032bc8-f990-4fc9-9a60-6fd64d4920c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:42.977948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558834f-9579-41e9-9762-2a5008fe71ce service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:42.980320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7558834f-9579-41e9-9762-2a5008fe71ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:43.261982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558834f-9579-41e9-9762-2a5008fe71ce service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:43.294500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:43.295547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:43.296064 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:43.296707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] PATH_INFO: `/v3/projects/e2b67816a87a4464882049359fd6bb2f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:43.300022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b67816a87a4464882049359fd6bb2f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:43.302171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: WARNING py.warnings [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 07 02:40:43.302171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: warnings.warn(msg) Feb 07 02:40:43.302171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: Feb 07 02:40:43.314440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:43.315772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84032bc8-f990-4fc9-9a60-6fd64d4920c1 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:43.348161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e573d0-99d7-4e0b-87f3-1cb60843bef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:43.349577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e573d0-99d7-4e0b-87f3-1cb60843bef8 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:43.349997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e573d0-99d7-4e0b-87f3-1cb60843bef8 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:43.351702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e573d0-99d7-4e0b-87f3-1cb60843bef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:43.476635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b67816a87a4464882049359fd6bb2f', 'request_id': 'req-60fcf49c-b537-4564-8225-5ddca9ee1453'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:43.512893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b67816a87a4464882049359fd6bb2f', 'request_id': 'req-60fcf49c-b537-4564-8225-5ddca9ee1453'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:43.532988 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b67816a87a4464882049359fd6bb2f', 'request_id': 'req-60fcf49c-b537-4564-8225-5ddca9ee1453'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:43.552188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] The token cache is being invalidate because project e2b67816a87a4464882049359fd6bb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:40:43.552583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:43.555447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:43.559301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 867/1728] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:40:42 2022] DELETE /identity/v3/projects/e2b67816a87a4464882049359fd6bb2f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:40:43.560290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:43.566506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:43.583686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e573d0-99d7-4e0b-87f3-1cb60843bef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:43.585374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e573d0-99d7-4e0b-87f3-1cb60843bef8 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:43.615048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 862/1729] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:43.634567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284951f-2629-4efd-927a-e20be3d79397 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:43.635317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284951f-2629-4efd-927a-e20be3d79397 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:43.635317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284951f-2629-4efd-927a-e20be3d79397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:43.709534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcf49c-b537-4564-8225-5ddca9ee1453 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:43.725364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0284951f-2629-4efd-927a-e20be3d79397 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:43.725492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141291d8-713f-4317-8a34-3f192839671e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:43.726624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141291d8-713f-4317-8a34-3f192839671e service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:43.726730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0284951f-2629-4efd-927a-e20be3d79397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:43.727310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141291d8-713f-4317-8a34-3f192839671e service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:43.727790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141291d8-713f-4317-8a34-3f192839671e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:43.733124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-141291d8-713f-4317-8a34-3f192839671e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:43.963007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141291d8-713f-4317-8a34-3f192839671e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:43.974142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141291d8-713f-4317-8a34-3f192839671e service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:44.008688 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 868/1730] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:44.081550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bde7f3-a0af-4c8b-b1c6-eaf277d8bcb9 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:44.082023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bde7f3-a0af-4c8b-b1c6-eaf277d8bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:44.082124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bde7f3-a0af-4c8b-b1c6-eaf277d8bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:44.113397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-38bde7f3-a0af-4c8b-b1c6-eaf277d8bcb9 None None] MFA Rules not processed for user `4197ebc1386c48e99fc150f70a1f8537`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:44.115346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-38bde7f3-a0af-4c8b-b1c6-eaf277d8bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:44.163434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 863/1731] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:44.171989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3603e-38fd-4955-b0d9-d123895b7072 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:44.172475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3603e-38fd-4955-b0d9-d123895b7072 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:44.176765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3603e-38fd-4955-b0d9-d123895b7072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:44.262668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-30e3603e-38fd-4955-b0d9-d123895b7072 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:44.265753 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-30e3603e-38fd-4955-b0d9-d123895b7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:44.277556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 869/1732] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:44.318776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bde7f3-a0af-4c8b-b1c6-eaf277d8bcb9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:44.325553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 864/1733] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:44.359772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bde7f3-a0af-4c8b-b1c6-eaf277d8bcb9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:44.369184 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac66b99-316b-41bc-929a-598182f38804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:44.370140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac66b99-316b-41bc-929a-598182f38804 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:44.370588 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac66b99-316b-41bc-929a-598182f38804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:44.376818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac66b99-316b-41bc-929a-598182f38804 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:44.378467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac66b99-316b-41bc-929a-598182f38804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:44.379715 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac66b99-316b-41bc-929a-598182f38804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:44.385383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac66b99-316b-41bc-929a-598182f38804 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:44.423569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 870/1734] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:44.424528 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3603e-38fd-4955-b0d9-d123895b7072 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:44.439998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3603e-38fd-4955-b0d9-d123895b7072 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:44.468407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4209f-1623-45f0-b73e-ee413163a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:44.477439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4209f-1623-45f0-b73e-ee413163a81a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:44.479635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4209f-1623-45f0-b73e-ee413163a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:44.481908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4209f-1623-45f0-b73e-ee413163a81a admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:44.488582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4209f-1623-45f0-b73e-ee413163a81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:44.498939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4209f-1623-45f0-b73e-ee413163a81a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:44.597397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac66b99-316b-41bc-929a-598182f38804 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:44.612406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 865/1735] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:44 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:40:44.613672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac66b99-316b-41bc-929a-598182f38804 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:44.750271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c1e18-afbd-497c-b104-ca92c5b0fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:44.753548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c1e18-afbd-497c-b104-ca92c5b0fe08 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:44.754528 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c1e18-afbd-497c-b104-ca92c5b0fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:44.755618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c1e18-afbd-497c-b104-ca92c5b0fe08 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:44.757005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c1e18-afbd-497c-b104-ca92c5b0fe08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:44.759162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c1e18-afbd-497c-b104-ca92c5b0fe08 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:44.824061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 871/1736] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:44 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:40:44.828372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4209f-1623-45f0-b73e-ee413163a81a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:44.851180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4209f-1623-45f0-b73e-ee413163a81a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:44.872205 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56237c3-4ad7-4533-924e-558d56c0189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:44.876231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56237c3-4ad7-4533-924e-558d56c0189b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:44.878740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56237c3-4ad7-4533-924e-558d56c0189b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:44.881319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56237c3-4ad7-4533-924e-558d56c0189b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:44.882462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56237c3-4ad7-4533-924e-558d56c0189b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:44.893064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56237c3-4ad7-4533-924e-558d56c0189b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:44.952410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 866/1737] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:40:44.957141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c1e18-afbd-497c-b104-ca92c5b0fe08 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:44.970418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c1e18-afbd-497c-b104-ca92c5b0fe08 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:44.984110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce4780-2668-43cf-9fb9-f9fc3e1912e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:44.985034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4780-2668-43cf-9fb9-f9fc3e1912e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:44.985306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4780-2668-43cf-9fb9-f9fc3e1912e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:44.985615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce4780-2668-43cf-9fb9-f9fc3e1912e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:44.986525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce4780-2668-43cf-9fb9-f9fc3e1912e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:44.993224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce4780-2668-43cf-9fb9-f9fc3e1912e0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:45.031451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56237c3-4ad7-4533-924e-558d56c0189b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:45.036418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 872/1738] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:45.063074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56237c3-4ad7-4533-924e-558d56c0189b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:45.096281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7dc81-80d0-4f44-a544-c3494e1133f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:45.105041 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7dc81-80d0-4f44-a544-c3494e1133f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:45.106282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7dc81-80d0-4f44-a544-c3494e1133f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:45.108050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7dc81-80d0-4f44-a544-c3494e1133f6 admin admin] PATH_INFO: `/v3/projects/e99fbc7ebdd547969049e103b9064c17/users/f7596f49c6854d3ea6b2c35cd7d38b04/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:45.174909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7dc81-80d0-4f44-a544-c3494e1133f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99fbc7ebdd547969049e103b9064c17, user_id=f7596f49c6854d3ea6b2c35cd7d38b04, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:45.186166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7dc81-80d0-4f44-a544-c3494e1133f6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:45.244566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 867/1739] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:45 2022] PUT /identity/v3/projects/e99fbc7ebdd547969049e103b9064c17/users/f7596f49c6854d3ea6b2c35cd7d38b04/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:45.256157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a8566-ac8f-4904-96be-ecc4a8f773a8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:45.256463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a8566-ac8f-4904-96be-ecc4a8f773a8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:45.256744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a8566-ac8f-4904-96be-ecc4a8f773a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:45.356711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-337a8566-ac8f-4904-96be-ecc4a8f773a8 None None] MFA Rules not processed for user `f7596f49c6854d3ea6b2c35cd7d38b04`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:45.358059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-337a8566-ac8f-4904-96be-ecc4a8f773a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:45.607463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 873/1740] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:45.675939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7dc81-80d0-4f44-a544-c3494e1133f6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:45.678291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-89d7dc81-80d0-4f44-a544-c3494e1133f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:45.831911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7dc81-80d0-4f44-a544-c3494e1133f6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:45.854116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d32883-ae98-4b73-89cb-c538cc26b0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:45.856042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32883-ae98-4b73-89cb-c538cc26b0bc service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:45.856527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32883-ae98-4b73-89cb-c538cc26b0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:45.856968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32883-ae98-4b73-89cb-c538cc26b0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:45.889061 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d32883-ae98-4b73-89cb-c538cc26b0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:45.891599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d32883-ae98-4b73-89cb-c538cc26b0bc service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:45.931698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 868/1741] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:46.604234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658c4e9-8398-4195-84a6-7faed58cc008 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:46.604834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658c4e9-8398-4195-84a6-7faed58cc008 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:46.605320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658c4e9-8398-4195-84a6-7faed58cc008 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:46.607772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 874/1742] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:40:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:40:46.826144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198476b-1009-4706-89b3-fba39eaaa29d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:46.827551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198476b-1009-4706-89b3-fba39eaaa29d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:46.828406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198476b-1009-4706-89b3-fba39eaaa29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:46.889552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e198476b-1009-4706-89b3-fba39eaaa29d None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:46.890958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e198476b-1009-4706-89b3-fba39eaaa29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:47.210097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 869/1743] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:40:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:40:47.885585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658c4e9-8398-4195-84a6-7faed58cc008 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:47.887433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2658c4e9-8398-4195-84a6-7faed58cc008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:47.940040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658c4e9-8398-4195-84a6-7faed58cc008 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:47.947826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5277c00-e1be-4b58-9a02-a280690473ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:47.949117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5277c00-e1be-4b58-9a02-a280690473ec service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:47.949604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5277c00-e1be-4b58-9a02-a280690473ec service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:47.950079 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5277c00-e1be-4b58-9a02-a280690473ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:47.964035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5277c00-e1be-4b58-9a02-a280690473ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:47.966062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5277c00-e1be-4b58-9a02-a280690473ec service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:47.995087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 875/1744] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:49.279275 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198476b-1009-4706-89b3-fba39eaaa29d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:49.280851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e198476b-1009-4706-89b3-fba39eaaa29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:49.560472 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198476b-1009-4706-89b3-fba39eaaa29d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:49.594732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:49.596037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:49.604766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:49.605054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] PATH_INFO: `/v3/users/5100fd1cc2d044e5839aa504bb287584` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:49.619587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5100fd1cc2d044e5839aa504bb287584)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:49.625514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:49.881763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5100fd1cc2d044e5839aa504bb287584'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:49.929289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5100fd1cc2d044e5839aa504bb287584'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:49.986007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5100fd1cc2d044e5839aa504bb287584'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:49.990299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5100fd1cc2d044e5839aa504bb287584'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:50.013652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5100fd1cc2d044e5839aa504bb287584'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:50.048757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 870/1745] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:40:49 2022] DELETE /identity/v3/users/5100fd1cc2d044e5839aa504bb287584 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:50.050651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a2e86-a5a9-4a27-a48b-513e174ab0f7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:50.051154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a2e86-a5a9-4a27-a48b-513e174ab0f7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:50.051347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a2e86-a5a9-4a27-a48b-513e174ab0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:50.109358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4e0a2e86-a5a9-4a27-a48b-513e174ab0f7 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:50.111090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4e0a2e86-a5a9-4a27-a48b-513e174ab0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:50.337745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 876/1746] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:50.399732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:50.402597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:50.671454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeeba5-86bb-428d-92a0-0f273623a7fb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:50.700730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c063f-b6b4-4e12-a4ef-67f1f6842f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:50.701603 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c063f-b6b4-4e12-a4ef-67f1f6842f39 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:50.702003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c063f-b6b4-4e12-a4ef-67f1f6842f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:50.703081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c063f-b6b4-4e12-a4ef-67f1f6842f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:50.751989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a2e86-a5a9-4a27-a48b-513e174ab0f7 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:50.753352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c063f-b6b4-4e12-a4ef-67f1f6842f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:50.755192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c063f-b6b4-4e12-a4ef-67f1f6842f39 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:50.755506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4e0a2e86-a5a9-4a27-a48b-513e174ab0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:50.768052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 871/1747] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:50.780859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a2e86-a5a9-4a27-a48b-513e174ab0f7 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:50.792627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:50.797141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:50.797667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:50.798090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] PATH_INFO: `/v3/users/591c7e5da2e04b039c66da959b11dd9c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:50.801219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=591c7e5da2e04b039c66da959b11dd9c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:50.813284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:50.961248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591c7e5da2e04b039c66da959b11dd9c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:50.986433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591c7e5da2e04b039c66da959b11dd9c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:50.998822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591c7e5da2e04b039c66da959b11dd9c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:51.059748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591c7e5da2e04b039c66da959b11dd9c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:51.064445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591c7e5da2e04b039c66da959b11dd9c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:51.099555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9d7e-6c15-4b3a-bf0a-3425edfee90c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:51.100477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9d7e-6c15-4b3a-bf0a-3425edfee90c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:51.101183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9d7e-6c15-4b3a-bf0a-3425edfee90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:51.103500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 877/1748] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:40:50 2022] DELETE /identity/v3/users/591c7e5da2e04b039c66da959b11dd9c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:51.130928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-943e9d7e-6c15-4b3a-bf0a-3425edfee90c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:51.132752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-943e9d7e-6c15-4b3a-bf0a-3425edfee90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:51.252873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 872/1749] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:51.539694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:51.541420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:51.746397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae110a-e55b-427e-bd5f-5ccb08b50960 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:51.760261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44b10-b8ba-4487-b554-1a7462ff0a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:51.761276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44b10-b8ba-4487-b554-1a7462ff0a47 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:51.761737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44b10-b8ba-4487-b554-1a7462ff0a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:51.762189 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44b10-b8ba-4487-b554-1a7462ff0a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:51.787847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a44b10-b8ba-4487-b554-1a7462ff0a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:51.789510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a44b10-b8ba-4487-b554-1a7462ff0a47 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:51.821865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 878/1750] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:53.252972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9d7e-6c15-4b3a-bf0a-3425edfee90c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:53.254452 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-943e9d7e-6c15-4b3a-bf0a-3425edfee90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:53.284878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e9d7e-6c15-4b3a-bf0a-3425edfee90c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:53.309909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:53.310788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:53.311071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:53.311345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] PATH_INFO: `/v3/projects/2ff988d3f58745d181ffb3be9e95c0dc` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:53.313872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff988d3f58745d181ffb3be9e95c0dc)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:53.326780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:53.456424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff988d3f58745d181ffb3be9e95c0dc', 'request_id': 'req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.482512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff988d3f58745d181ffb3be9e95c0dc', 'request_id': 'req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.499714 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff988d3f58745d181ffb3be9e95c0dc', 'request_id': 'req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.535438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] The token cache is being invalidate because project 2ff988d3f58745d181ffb3be9e95c0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:40:53.536250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.540831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.548388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44b10-b8ba-4487-b554-1a7462ff0a47 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:53.562176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 873/1751] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:40:53 2022] DELETE /identity/v3/projects/2ff988d3f58745d181ffb3be9e95c0dc => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:53.573296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44b10-b8ba-4487-b554-1a7462ff0a47 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:53.731179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:53.732161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:53.732641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:53.732867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] PATH_INFO: `/v3/users/957ac57958fd4c6d82bff1f969ea5a55` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:53.735987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=957ac57958fd4c6d82bff1f969ea5a55)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:53.746099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:53.837456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957ac57958fd4c6d82bff1f969ea5a55'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.853238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957ac57958fd4c6d82bff1f969ea5a55'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.875409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957ac57958fd4c6d82bff1f969ea5a55'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.916558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957ac57958fd4c6d82bff1f969ea5a55'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.923080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8df56594-4d3d-4935-88a6-1b774d980e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957ac57958fd4c6d82bff1f969ea5a55'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:53.958505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 879/1752] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:40:53 2022] DELETE /identity/v3/users/957ac57958fd4c6d82bff1f969ea5a55 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:54.345072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:54.346775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:54.382733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655ff9-014a-4d0f-869a-a6b88d3d5ce4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:54.612935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:54.613867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:54.614307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:54.614726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] PATH_INFO: `/v3/projects/b623384d789047ce8e06dfad60065439` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:54.622002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b623384d789047ce8e06dfad60065439)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:54.637147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:54.821690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f1948-0360-41d0-b663-6d369b48ec38 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:54.822783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f1948-0360-41d0-b663-6d369b48ec38 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:54.823695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f1948-0360-41d0-b663-6d369b48ec38 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:54.825965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 880/1753] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:40:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 07 02:40:54.834215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b623384d789047ce8e06dfad60065439', 'request_id': 'req-93768c42-6a95-44f7-8f1f-3f4324cf68af'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:54.854432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b623384d789047ce8e06dfad60065439', 'request_id': 'req-93768c42-6a95-44f7-8f1f-3f4324cf68af'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:54.872668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b623384d789047ce8e06dfad60065439', 'request_id': 'req-93768c42-6a95-44f7-8f1f-3f4324cf68af'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:54.898726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] The token cache is being invalidate because project b623384d789047ce8e06dfad60065439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:40:54.899396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:54.931025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-93768c42-6a95-44f7-8f1f-3f4324cf68af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:54.939060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 874/1754] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:40:54 2022] DELETE /identity/v3/projects/b623384d789047ce8e06dfad60065439 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:54.940050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f1948-0360-41d0-b663-6d369b48ec38 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:54.941867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-805f1948-0360-41d0-b663-6d369b48ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:55.005799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60011a4c-736f-4071-8255-5815250544d1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:55.006297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60011a4c-736f-4071-8255-5815250544d1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:55.006869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60011a4c-736f-4071-8255-5815250544d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:55.056955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-60011a4c-736f-4071-8255-5815250544d1 None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:55.062417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-60011a4c-736f-4071-8255-5815250544d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:55.143108 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f1948-0360-41d0-b663-6d369b48ec38 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:55.153037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:55.154901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:55.155419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:55.155871 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] PATH_INFO: `/v3/users/c541d1b0ca604f2bade2d4f15e1fa217` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:55.158486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c541d1b0ca604f2bade2d4f15e1fa217)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:55.164364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:55.245775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c541d1b0ca604f2bade2d4f15e1fa217'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:55.265270 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c541d1b0ca604f2bade2d4f15e1fa217'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:55.308166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c541d1b0ca604f2bade2d4f15e1fa217'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:55.309590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 875/1755] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:40:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:55.311767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff20bc-9bb5-4312-bdcc-bbdfee7e8579 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:55.312176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff20bc-9bb5-4312-bdcc-bbdfee7e8579 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:55.312667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff20bc-9bb5-4312-bdcc-bbdfee7e8579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:55.349973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c541d1b0ca604f2bade2d4f15e1fa217'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:55.351382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c541d1b0ca604f2bade2d4f15e1fa217'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:55.367349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5cff20bc-9bb5-4312-bdcc-bbdfee7e8579 None None] MFA Rules not processed for user `96cb52955ccd402f91bb0c3c982ae6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:55.369472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 881/1756] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:40:54 2022] DELETE /identity/v3/users/c541d1b0ca604f2bade2d4f15e1fa217 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:55.375237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5cff20bc-9bb5-4312-bdcc-bbdfee7e8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:55.392868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:55.396093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:55.506158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2f428-63ce-4532-95d7-5bd39f127221 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:55.511549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 876/1757] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:55.522843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34cd45-b150-4f4e-866a-15a32ff5e11f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:55.523450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34cd45-b150-4f4e-866a-15a32ff5e11f service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:55.524624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34cd45-b150-4f4e-866a-15a32ff5e11f service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:55.525084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34cd45-b150-4f4e-866a-15a32ff5e11f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:55.533890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fb34cd45-b150-4f4e-866a-15a32ff5e11f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:55.560688 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34cd45-b150-4f4e-866a-15a32ff5e11f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:55.562601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34cd45-b150-4f4e-866a-15a32ff5e11f service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:55.576709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 882/1758] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:40:56.442768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff20bc-9bb5-4312-bdcc-bbdfee7e8579 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:56.445202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5cff20bc-9bb5-4312-bdcc-bbdfee7e8579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:56.528497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff20bc-9bb5-4312-bdcc-bbdfee7e8579 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:56.536363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:56.537349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:56.537842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:56.538335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] PATH_INFO: `/v3/projects/84a6c36ad0cc4a84b124c03e36488836` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:56.540760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a6c36ad0cc4a84b124c03e36488836)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:56.542999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:56.629473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a6c36ad0cc4a84b124c03e36488836', 'request_id': 'req-976615d6-92ff-40c8-a3f0-3f08685d402e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:56.659279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a6c36ad0cc4a84b124c03e36488836', 'request_id': 'req-976615d6-92ff-40c8-a3f0-3f08685d402e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:56.696955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a6c36ad0cc4a84b124c03e36488836', 'request_id': 'req-976615d6-92ff-40c8-a3f0-3f08685d402e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:56.725534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] The token cache is being invalidate because project 84a6c36ad0cc4a84b124c03e36488836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:40:56.725775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:56.728700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-976615d6-92ff-40c8-a3f0-3f08685d402e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:56.733439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 877/1759] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:40:56 2022] DELETE /identity/v3/projects/84a6c36ad0cc4a84b124c03e36488836 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:56.741051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e36e6-7d29-4498-bc05-34348648d2d0 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:56.741542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e36e6-7d29-4498-bc05-34348648d2d0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:56.742040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e36e6-7d29-4498-bc05-34348648d2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:56.784160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4b6e36e6-7d29-4498-bc05-34348648d2d0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:56.794751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4b6e36e6-7d29-4498-bc05-34348648d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:56.909443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 883/1760] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:56.918877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b386b-7070-4906-90dd-46ea4a03e222 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:56.919616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e36e6-7d29-4498-bc05-34348648d2d0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:56.920702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b386b-7070-4906-90dd-46ea4a03e222 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:56.922033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b386b-7070-4906-90dd-46ea4a03e222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:56.926229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4b6e36e6-7d29-4498-bc05-34348648d2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:56.955173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a55b386b-7070-4906-90dd-46ea4a03e222 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:56.956842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a55b386b-7070-4906-90dd-46ea4a03e222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:56.959259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e36e6-7d29-4498-bc05-34348648d2d0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:56.969752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 878/1761] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:40:56.973589 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:56.974113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b386b-7070-4906-90dd-46ea4a03e222 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:56.974468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:56.974771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:56.975088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] PATH_INFO: `/v3/projects/ce5f170a3bfa4e67a935d1e3c1f977fe` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:56.976771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5f170a3bfa4e67a935d1e3c1f977fe)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:56.987030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:57.005232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b386b-7070-4906-90dd-46ea4a03e222 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:57.017971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868566d-8a66-48a2-9101-cd86cca75f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:57.018891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868566d-8a66-48a2-9101-cd86cca75f4b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.019287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868566d-8a66-48a2-9101-cd86cca75f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.022080 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868566d-8a66-48a2-9101-cd86cca75f4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.026018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868566d-8a66-48a2-9101-cd86cca75f4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:57.026487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868566d-8a66-48a2-9101-cd86cca75f4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:57.028421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868566d-8a66-48a2-9101-cd86cca75f4b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:57.062186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 879/1762] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:57.068046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868566d-8a66-48a2-9101-cd86cca75f4b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:57.115225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5f170a3bfa4e67a935d1e3c1f977fe', 'request_id': 'req-f279554a-bff1-4d21-944d-a74dd24c43b1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:57.122599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868566d-8a66-48a2-9101-cd86cca75f4b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:57.133556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5f170a3bfa4e67a935d1e3c1f977fe', 'request_id': 'req-f279554a-bff1-4d21-944d-a74dd24c43b1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:57.167286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5f170a3bfa4e67a935d1e3c1f977fe', 'request_id': 'req-f279554a-bff1-4d21-944d-a74dd24c43b1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:57.192392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] The token cache is being invalidate because project ce5f170a3bfa4e67a935d1e3c1f977fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:40:57.192676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:57.195235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f279554a-bff1-4d21-944d-a74dd24c43b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:40:57.200628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 884/1763] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:40:56 2022] DELETE /identity/v3/projects/ce5f170a3bfa4e67a935d1e3c1f977fe => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:57.200628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7952-4fac-4cc3-97d4-f2955db34b05 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.200628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7952-4fac-4cc3-97d4-f2955db34b05 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.200951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7952-4fac-4cc3-97d4-f2955db34b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.242307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-dddc7952-4fac-4cc3-97d4-f2955db34b05 None None] MFA Rules not processed for user `4a6e100dfcd5498fa5e2a5a1b04429dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:57.243454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dddc7952-4fac-4cc3-97d4-f2955db34b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:57.292485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cfa7d-040f-48f3-a85f-ad4c8bcb3542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:57.294052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cfa7d-040f-48f3-a85f-ad4c8bcb3542 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.294340 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cfa7d-040f-48f3-a85f-ad4c8bcb3542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.294616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cfa7d-040f-48f3-a85f-ad4c8bcb3542 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.296899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cfa7d-040f-48f3-a85f-ad4c8bcb3542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:57.299857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cfa7d-040f-48f3-a85f-ad4c8bcb3542 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:57.351318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 880/1764] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:57 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:57.354024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24891-b86a-4f74-95db-acd43ac75cd8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.354840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24891-b86a-4f74-95db-acd43ac75cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.356155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24891-b86a-4f74-95db-acd43ac75cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.369869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 885/1765] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:57.369869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7952-4fac-4cc3-97d4-f2955db34b05 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:57.372320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dddc7952-4fac-4cc3-97d4-f2955db34b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:57.395169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-07a24891-b86a-4f74-95db-acd43ac75cd8 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:57.398283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-07a24891-b86a-4f74-95db-acd43ac75cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:57.402438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7952-4fac-4cc3-97d4-f2955db34b05 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:57.525769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa237a69-1377-485f-a14e-812807806ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:57.526616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa237a69-1377-485f-a14e-812807806ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.530680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa237a69-1377-485f-a14e-812807806ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.531040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa237a69-1377-485f-a14e-812807806ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.531932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa237a69-1377-485f-a14e-812807806ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:57.534149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa237a69-1377-485f-a14e-812807806ce5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:57.546089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 881/1766] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:57.554244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dfc66-d34b-4e07-ad80-051038483442 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.555802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dfc66-d34b-4e07-ad80-051038483442 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.556229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9dfc66-d34b-4e07-ad80-051038483442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.582592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 886/1767] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:57 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:57.586002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa237a69-1377-485f-a14e-812807806ce5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:57.592392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2b9dfc66-d34b-4e07-ad80-051038483442 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:57.593580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2b9dfc66-d34b-4e07-ad80-051038483442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:57.617799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa237a69-1377-485f-a14e-812807806ce5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:57.619758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 882/1768] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:57.621638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dfc66-d34b-4e07-ad80-051038483442 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:57.643997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9dfc66-d34b-4e07-ad80-051038483442 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:57.650140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cecb3-8db7-4f7f-9262-982ceaefc97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:57.654241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cecb3-8db7-4f7f-9262-982ceaefc97e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.654410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a66f1-b07e-4ddb-b3c1-685091efe3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:57.655055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a66f1-b07e-4ddb-b3c1-685091efe3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.655336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a66f1-b07e-4ddb-b3c1-685091efe3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.656244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a66f1-b07e-4ddb-b3c1-685091efe3c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.656934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cecb3-8db7-4f7f-9262-982ceaefc97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.657163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a66f1-b07e-4ddb-b3c1-685091efe3c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:40:57.657477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a66f1-b07e-4ddb-b3c1-685091efe3c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:57.657895 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cecb3-8db7-4f7f-9262-982ceaefc97e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.658823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cecb3-8db7-4f7f-9262-982ceaefc97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:57.659287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a66f1-b07e-4ddb-b3c1-685091efe3c2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:57.663306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cecb3-8db7-4f7f-9262-982ceaefc97e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:57.684373 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 887/1769] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:57.689732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cecb3-8db7-4f7f-9262-982ceaefc97e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:57.694320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 883/1770] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:40:57.695213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a66f1-b07e-4ddb-b3c1-685091efe3c2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:57.704642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cecb3-8db7-4f7f-9262-982ceaefc97e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:57.706304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a66f1-b07e-4ddb-b3c1-685091efe3c2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:57.710595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fc861-0270-43c6-8c67-9ad3dfbef7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:57.711407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1a04a-de9b-4c32-b0ac-84fee5082df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:57.711552 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fc861-0270-43c6-8c67-9ad3dfbef7de admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.711918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fc861-0270-43c6-8c67-9ad3dfbef7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.712292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fc861-0270-43c6-8c67-9ad3dfbef7de admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.712917 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a04a-de9b-4c32-b0ac-84fee5082df5 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.713206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a04a-de9b-4c32-b0ac-84fee5082df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.713322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fc861-0270-43c6-8c67-9ad3dfbef7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:57.713482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a04a-de9b-4c32-b0ac-84fee5082df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.714813 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1a04a-de9b-4c32-b0ac-84fee5082df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:57.715119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fc861-0270-43c6-8c67-9ad3dfbef7de admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:57.716758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1a04a-de9b-4c32-b0ac-84fee5082df5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:57.727904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 888/1771] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:57.731937 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fc861-0270-43c6-8c67-9ad3dfbef7de admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:57.747825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fc861-0270-43c6-8c67-9ad3dfbef7de admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:57.762923 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 884/1772] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:57 2022] POST /identity/v3/projects => generated 401 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:57.763596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9d333-93bd-450c-be96-77139584d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:57.764532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9d333-93bd-450c-be96-77139584d5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.764801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9d333-93bd-450c-be96-77139584d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.765075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9d333-93bd-450c-be96-77139584d5a9 admin admin] PATH_INFO: `/v3/projects/bd996ef1c51d473dbf5ff7e5fe2b7dd6/users/bfd6087d4b4d4a35947a01769e1e63b8/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.767790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1a04a-de9b-4c32-b0ac-84fee5082df5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:57.806381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9d333-93bd-450c-be96-77139584d5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd996ef1c51d473dbf5ff7e5fe2b7dd6, user_id=bfd6087d4b4d4a35947a01769e1e63b8, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:57.813606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9d333-93bd-450c-be96-77139584d5a9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:57.846037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 889/1773] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:57 2022] PUT /identity/v3/projects/bd996ef1c51d473dbf5ff7e5fe2b7dd6/users/bfd6087d4b4d4a35947a01769e1e63b8/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:57.852070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183a4f6-e80c-4773-9ba3-7bb7ef8f8dd5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:57.852413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183a4f6-e80c-4773-9ba3-7bb7ef8f8dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:57.853479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183a4f6-e80c-4773-9ba3-7bb7ef8f8dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:57.898618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0183a4f6-e80c-4773-9ba3-7bb7ef8f8dd5 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:57.899893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0183a4f6-e80c-4773-9ba3-7bb7ef8f8dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:57.937336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1a04a-de9b-4c32-b0ac-84fee5082df5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:58.074351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e20ad-e94b-47e5-b052-0d1bab62dc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:58.075024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e20ad-e94b-47e5-b052-0d1bab62dc21 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.075302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e20ad-e94b-47e5-b052-0d1bab62dc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.075571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e20ad-e94b-47e5-b052-0d1bab62dc21 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.076443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e20ad-e94b-47e5-b052-0d1bab62dc21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:58.079178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e20ad-e94b-47e5-b052-0d1bab62dc21 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:58.099369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 890/1774] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:58.106557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183a4f6-e80c-4773-9ba3-7bb7ef8f8dd5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:58.116169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 885/1775] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:57 2022] POST /identity/v3/users => generated 301 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:40:58.116371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0183a4f6-e80c-4773-9ba3-7bb7ef8f8dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:58.117827 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e20ad-e94b-47e5-b052-0d1bab62dc21 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:58.128905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e20ad-e94b-47e5-b052-0d1bab62dc21 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:58.134822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378608-4777-4221-9a36-4efad4a1e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:58.135499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378608-4777-4221-9a36-4efad4a1e199 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.135778 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378608-4777-4221-9a36-4efad4a1e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.136053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378608-4777-4221-9a36-4efad4a1e199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.136838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5378608-4777-4221-9a36-4efad4a1e199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:58.138622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5378608-4777-4221-9a36-4efad4a1e199 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:58.156379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 886/1776] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:40:58.158292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378608-4777-4221-9a36-4efad4a1e199 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:58.169737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378608-4777-4221-9a36-4efad4a1e199 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:58.174911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bbe67-fed5-4bd8-ae72-13a053245a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:58.176073 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bbe67-fed5-4bd8-ae72-13a053245a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.176590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bbe67-fed5-4bd8-ae72-13a053245a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.177048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bbe67-fed5-4bd8-ae72-13a053245a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.177907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bbe67-fed5-4bd8-ae72-13a053245a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:58.179580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bbe67-fed5-4bd8-ae72-13a053245a4e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:58.206504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 887/1777] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:58.211179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bbe67-fed5-4bd8-ae72-13a053245a4e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:58.226946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bbe67-fed5-4bd8-ae72-13a053245a4e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:58.232562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c666c-22eb-4feb-9c5f-8e72c54a4fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:58.233222 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c666c-22eb-4feb-9c5f-8e72c54a4fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.233495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c666c-22eb-4feb-9c5f-8e72c54a4fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.233596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183a4f6-e80c-4773-9ba3-7bb7ef8f8dd5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:58.234597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c666c-22eb-4feb-9c5f-8e72c54a4fb8 admin admin] PATH_INFO: `/v3/projects/0a289bbf18e14193a68b716d4f0150bf/users/e9657e7a371540a788cbfc77cbd32340/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.249660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72184f75-c8bc-483d-954e-3264f8ace19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:58.252983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72184f75-c8bc-483d-954e-3264f8ace19a service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.253370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72184f75-c8bc-483d-954e-3264f8ace19a service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.253760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72184f75-c8bc-483d-954e-3264f8ace19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.258476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c666c-22eb-4feb-9c5f-8e72c54a4fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a289bbf18e14193a68b716d4f0150bf, user_id=e9657e7a371540a788cbfc77cbd32340, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:58.261759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c666c-22eb-4feb-9c5f-8e72c54a4fb8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:58.281875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72184f75-c8bc-483d-954e-3264f8ace19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:58.286104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72184f75-c8bc-483d-954e-3264f8ace19a service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:58.296042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 888/1778] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:58 2022] PUT /identity/v3/projects/0a289bbf18e14193a68b716d4f0150bf/users/e9657e7a371540a788cbfc77cbd32340/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:40:58.317300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741fbe-b734-4114-870d-2f04c9d8fb38 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.317792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741fbe-b734-4114-870d-2f04c9d8fb38 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.318078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741fbe-b734-4114-870d-2f04c9d8fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.318533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 891/1779] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:58.385074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f9741fbe-b734-4114-870d-2f04c9d8fb38 None None] MFA Rules not processed for user `e9657e7a371540a788cbfc77cbd32340`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:58.386541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f9741fbe-b734-4114-870d-2f04c9d8fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:58.482456 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 889/1780] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:58.487971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72184f75-c8bc-483d-954e-3264f8ace19a service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:58.497814 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72184f75-c8bc-483d-954e-3264f8ace19a service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:58.577277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b7996-890f-496f-b0f9-fd0ae981b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:58.577955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b7996-890f-496f-b0f9-fd0ae981b169 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.578236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b7996-890f-496f-b0f9-fd0ae981b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.578514 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b7996-890f-496f-b0f9-fd0ae981b169 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.579464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b7996-890f-496f-b0f9-fd0ae981b169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:58.581701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b7996-890f-496f-b0f9-fd0ae981b169 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:58.617032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9741fbe-b734-4114-870d-2f04c9d8fb38 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:58.632619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 892/1781] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:58 2022] POST /identity/v3/projects => generated 399 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:58.644105 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9741fbe-b734-4114-870d-2f04c9d8fb38 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:58.734342 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90e26b-f2e7-419f-a17c-ad4f67b8e9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:58.735027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90e26b-f2e7-419f-a17c-ad4f67b8e9dd admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.735308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90e26b-f2e7-419f-a17c-ad4f67b8e9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.735582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90e26b-f2e7-419f-a17c-ad4f67b8e9dd admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.736292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90e26b-f2e7-419f-a17c-ad4f67b8e9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:58.739075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90e26b-f2e7-419f-a17c-ad4f67b8e9dd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:58.772791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 890/1782] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:58 2022] POST /identity/v3/users => generated 306 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:58.774970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b7996-890f-496f-b0f9-fd0ae981b169 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:58.786758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b7996-890f-496f-b0f9-fd0ae981b169 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:58.792837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7eb8-79fd-405f-a0c2-a465cb84eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:58.793513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7eb8-79fd-405f-a0c2-a465cb84eeae admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.793793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7eb8-79fd-405f-a0c2-a465cb84eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.794069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7eb8-79fd-405f-a0c2-a465cb84eeae admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.794809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7eb8-79fd-405f-a0c2-a465cb84eeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:58.796459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7eb8-79fd-405f-a0c2-a465cb84eeae admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:58.809663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 893/1783] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:58.813829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90e26b-f2e7-419f-a17c-ad4f67b8e9dd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:58.831405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90e26b-f2e7-419f-a17c-ad4f67b8e9dd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:58.836540 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a9574-88a7-4c4b-bd81-ec127fecb6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:58.837417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a9574-88a7-4c4b-bd81-ec127fecb6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:58.837777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a9574-88a7-4c4b-bd81-ec127fecb6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:58.837989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a9574-88a7-4c4b-bd81-ec127fecb6b3 admin admin] PATH_INFO: `/v3/projects/c8a7af2a68604326b39adde6a509460d/users/1e4fc3aa476d4c4da80695ab7c79df04/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:58.854929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a9574-88a7-4c4b-bd81-ec127fecb6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a7af2a68604326b39adde6a509460d, user_id=1e4fc3aa476d4c4da80695ab7c79df04, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:58.857702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a9574-88a7-4c4b-bd81-ec127fecb6b3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:58.873122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 891/1784] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:58 2022] PUT /identity/v3/projects/c8a7af2a68604326b39adde6a509460d/users/1e4fc3aa476d4c4da80695ab7c79df04/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:58.878808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7eb8-79fd-405f-a0c2-a465cb84eeae admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:58.905943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7eb8-79fd-405f-a0c2-a465cb84eeae admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.013111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdd6a1-6e36-4e9b-a2a5-373b1e7441dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.014051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdd6a1-6e36-4e9b-a2a5-373b1e7441dc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.014377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdd6a1-6e36-4e9b-a2a5-373b1e7441dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.014650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdd6a1-6e36-4e9b-a2a5-373b1e7441dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.015568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdd6a1-6e36-4e9b-a2a5-373b1e7441dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.017979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdd6a1-6e36-4e9b-a2a5-373b1e7441dc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.033297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 894/1785] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:59.038265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a9574-88a7-4c4b-bd81-ec127fecb6b3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:59.053506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a9574-88a7-4c4b-bd81-ec127fecb6b3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.062861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc8c8e-a66a-48a9-b14b-bc5a49067294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.064434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc8c8e-a66a-48a9-b14b-bc5a49067294 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.064996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc8c8e-a66a-48a9-b14b-bc5a49067294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.065325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc8c8e-a66a-48a9-b14b-bc5a49067294 admin admin] PATH_INFO: `/v3/projects/c8a7af2a68604326b39adde6a509460d/users/1e4fc3aa476d4c4da80695ab7c79df04/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.068459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc8c8e-a66a-48a9-b14b-bc5a49067294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a7af2a68604326b39adde6a509460d, user_id=1e4fc3aa476d4c4da80695ab7c79df04, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.070921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc8c8e-a66a-48a9-b14b-bc5a49067294 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.107812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 892/1786] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:59 2022] PUT /identity/v3/projects/c8a7af2a68604326b39adde6a509460d/users/1e4fc3aa476d4c4da80695ab7c79df04/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:59.109133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731acd9-188d-4472-85b3-c29560385f3d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.109425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731acd9-188d-4472-85b3-c29560385f3d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.110478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731acd9-188d-4472-85b3-c29560385f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.144308 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7731acd9-188d-4472-85b3-c29560385f3d None None] MFA Rules not processed for user `1e4fc3aa476d4c4da80695ab7c79df04`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:59.145584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7731acd9-188d-4472-85b3-c29560385f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:59.224819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 895/1787] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:40:59.232007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc8c8e-a66a-48a9-b14b-bc5a49067294 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:59.233557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-03fc8c8e-a66a-48a9-b14b-bc5a49067294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:59.291691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88ca8-27da-4fa2-8372-323ab4d64db8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.291988 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88ca8-27da-4fa2-8372-323ab4d64db8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.292267 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f88ca8-27da-4fa2-8372-323ab4d64db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.294741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc8c8e-a66a-48a9-b14b-bc5a49067294 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.298553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f018958-67c5-4df0-a590-269d01f4f359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.299396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f018958-67c5-4df0-a590-269d01f4f359 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.299823 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f018958-67c5-4df0-a590-269d01f4f359 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.300097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f018958-67c5-4df0-a590-269d01f4f359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.310873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f018958-67c5-4df0-a590-269d01f4f359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.312301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f018958-67c5-4df0-a590-269d01f4f359 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.321033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-30f88ca8-27da-4fa2-8372-323ab4d64db8 None None] MFA Rules not processed for user `bfd6087d4b4d4a35947a01769e1e63b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:40:59.322385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-30f88ca8-27da-4fa2-8372-323ab4d64db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:40:59.323716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 893/1788] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:59 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:40:59.398698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 896/1789] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:40:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:40:59.402887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f018958-67c5-4df0-a590-269d01f4f359 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:59.407744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f88ca8-27da-4fa2-8372-323ab4d64db8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:59.418168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f88ca8-27da-4fa2-8372-323ab4d64db8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.422293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02395aa4-7fc5-47c5-bd98-55fc2ce6c7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.422963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395aa4-7fc5-47c5-bd98-55fc2ce6c7cf service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.423246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395aa4-7fc5-47c5-bd98-55fc2ce6c7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.423512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02395aa4-7fc5-47c5-bd98-55fc2ce6c7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.470244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f018958-67c5-4df0-a590-269d01f4f359 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.475485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce910e16-b444-414f-88e3-18baf4db8987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.476135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce910e16-b444-414f-88e3-18baf4db8987 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.476463 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce910e16-b444-414f-88e3-18baf4db8987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.476741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce910e16-b444-414f-88e3-18baf4db8987 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.477445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce910e16-b444-414f-88e3-18baf4db8987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.479341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce910e16-b444-414f-88e3-18baf4db8987 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.483406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02395aa4-7fc5-47c5-bd98-55fc2ce6c7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.484896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02395aa4-7fc5-47c5-bd98-55fc2ce6c7cf service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.495380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 897/1790] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:40:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:40:59.512492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 894/1791] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:40:59 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:59.513551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02395aa4-7fc5-47c5-bd98-55fc2ce6c7cf service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:59.524979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02395aa4-7fc5-47c5-bd98-55fc2ce6c7cf service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.587845 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a928f-a458-4e47-a355-5b70e3fa66f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.588853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a928f-a458-4e47-a355-5b70e3fa66f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.589206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a928f-a458-4e47-a355-5b70e3fa66f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.589561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a928f-a458-4e47-a355-5b70e3fa66f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.590414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a928f-a458-4e47-a355-5b70e3fa66f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.593503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a928f-a458-4e47-a355-5b70e3fa66f8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.620042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 898/1792] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:40:59 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:40:59.624252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce910e16-b444-414f-88e3-18baf4db8987 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:59.635545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce910e16-b444-414f-88e3-18baf4db8987 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.640967 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4e217-bdfb-4cc4-b4ba-c9b15d35aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.641636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e217-bdfb-4cc4-b4ba-c9b15d35aab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.641915 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e217-bdfb-4cc4-b4ba-c9b15d35aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.642189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e217-bdfb-4cc4-b4ba-c9b15d35aab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.642925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4e217-bdfb-4cc4-b4ba-c9b15d35aab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.645057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4e217-bdfb-4cc4-b4ba-c9b15d35aab4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.662002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 895/1793] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:59.663336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a928f-a458-4e47-a355-5b70e3fa66f8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:59.678899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a928f-a458-4e47-a355-5b70e3fa66f8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.684004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331049f-590a-49c6-b1ae-6f77eda9f6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.684935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331049f-590a-49c6-b1ae-6f77eda9f6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.685216 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331049f-590a-49c6-b1ae-6f77eda9f6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.685491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331049f-590a-49c6-b1ae-6f77eda9f6d6 admin admin] PATH_INFO: `/v3/projects/d41c45e12fe74d90b89a6c56b1345ca4/users/4db3af371b82495d9ff04c55ef39dfe4/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.701899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331049f-590a-49c6-b1ae-6f77eda9f6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41c45e12fe74d90b89a6c56b1345ca4, user_id=4db3af371b82495d9ff04c55ef39dfe4, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.704568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331049f-590a-49c6-b1ae-6f77eda9f6d6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.717866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 899/1794] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:59 2022] PUT /identity/v3/projects/d41c45e12fe74d90b89a6c56b1345ca4/users/4db3af371b82495d9ff04c55ef39dfe4/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:40:59.721901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4e217-bdfb-4cc4-b4ba-c9b15d35aab4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:59.742859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4e217-bdfb-4cc4-b4ba-c9b15d35aab4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.817215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec36ae-e6b7-4cf3-ae42-cb88f395749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.817962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec36ae-e6b7-4cf3-ae42-cb88f395749c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.818313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec36ae-e6b7-4cf3-ae42-cb88f395749c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.818661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec36ae-e6b7-4cf3-ae42-cb88f395749c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.819484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec36ae-e6b7-4cf3-ae42-cb88f395749c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.821180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec36ae-e6b7-4cf3-ae42-cb88f395749c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.831594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 896/1795] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:40:59.836407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331049f-590a-49c6-b1ae-6f77eda9f6d6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:40:59.847293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331049f-590a-49c6-b1ae-6f77eda9f6d6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:40:59.854623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14086233-2a14-40ec-b3bc-acbcc1c09ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:40:59.855446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14086233-2a14-40ec-b3bc-acbcc1c09ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:40:59.855721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14086233-2a14-40ec-b3bc-acbcc1c09ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:40:59.855990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14086233-2a14-40ec-b3bc-acbcc1c09ebb admin admin] PATH_INFO: `/v3/projects/d41c45e12fe74d90b89a6c56b1345ca4/users/4db3af371b82495d9ff04c55ef39dfe4/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:40:59.859040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14086233-2a14-40ec-b3bc-acbcc1c09ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41c45e12fe74d90b89a6c56b1345ca4, user_id=4db3af371b82495d9ff04c55ef39dfe4, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:40:59.862010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14086233-2a14-40ec-b3bc-acbcc1c09ebb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:40:59.873243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 900/1796] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:40:59 2022] PUT /identity/v3/projects/d41c45e12fe74d90b89a6c56b1345ca4/users/4db3af371b82495d9ff04c55ef39dfe4/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:01.141842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267f8e-46c0-4d67-bd5e-3a82fe38890d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:01.141842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267f8e-46c0-4d67-bd5e-3a82fe38890d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:01.141842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da267f8e-46c0-4d67-bd5e-3a82fe38890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:01.182965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-da267f8e-46c0-4d67-bd5e-3a82fe38890d None None] MFA Rules not processed for user `4db3af371b82495d9ff04c55ef39dfe4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:01.189218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-da267f8e-46c0-4d67-bd5e-3a82fe38890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:01.298598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 897/1797] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:01.306314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14086233-2a14-40ec-b3bc-acbcc1c09ebb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:01.367576 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14086233-2a14-40ec-b3bc-acbcc1c09ebb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:01.374073 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d3208-8ee2-48c7-859f-6a953eaf8df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:01.374728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d3208-8ee2-48c7-859f-6a953eaf8df0 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:01.375016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d3208-8ee2-48c7-859f-6a953eaf8df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:01.375994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d3208-8ee2-48c7-859f-6a953eaf8df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:01.431275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d3208-8ee2-48c7-859f-6a953eaf8df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:01.432758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d3208-8ee2-48c7-859f-6a953eaf8df0 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:01.444098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 901/1798] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:04.333141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267f8e-46c0-4d67-bd5e-3a82fe38890d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:04.334592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-da267f8e-46c0-4d67-bd5e-3a82fe38890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:04.463148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da267f8e-46c0-4d67-bd5e-3a82fe38890d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:04.468877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:04.469868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:04.470211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:04.470635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] PATH_INFO: `/v3/users/f7596f49c6854d3ea6b2c35cd7d38b04` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:04.472091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7596f49c6854d3ea6b2c35cd7d38b04)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:04.474638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:04.533533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7596f49c6854d3ea6b2c35cd7d38b04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:04.542539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7596f49c6854d3ea6b2c35cd7d38b04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:04.555651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7596f49c6854d3ea6b2c35cd7d38b04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:04.558686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7596f49c6854d3ea6b2c35cd7d38b04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:04.570980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7596f49c6854d3ea6b2c35cd7d38b04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:04.586203 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 898/1799] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:04 2022] DELETE /identity/v3/users/f7596f49c6854d3ea6b2c35cd7d38b04 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:04.591892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea028-ee86-467c-8988-5bb9f23cd3f2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:04.592441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea028-ee86-467c-8988-5bb9f23cd3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:04.592565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea028-ee86-467c-8988-5bb9f23cd3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:04.617346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-55cea028-ee86-467c-8988-5bb9f23cd3f2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:04.618737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-55cea028-ee86-467c-8988-5bb9f23cd3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:04.682560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 902/1800] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:04.696055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:04.697863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:04.770526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271d2f2-5c12-4592-9ca6-bd93b0d94cb2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:04.775250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca17a4-9f2e-46f8-931b-3ec78824b279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:04.775808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca17a4-9f2e-46f8-931b-3ec78824b279 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:04.776096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca17a4-9f2e-46f8-931b-3ec78824b279 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:04.776429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca17a4-9f2e-46f8-931b-3ec78824b279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:04.796071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca17a4-9f2e-46f8-931b-3ec78824b279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:04.797421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca17a4-9f2e-46f8-931b-3ec78824b279 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:04.815164 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 899/1801] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:04.851776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea028-ee86-467c-8988-5bb9f23cd3f2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:04.853591 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-55cea028-ee86-467c-8988-5bb9f23cd3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:04.868800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea028-ee86-467c-8988-5bb9f23cd3f2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:04.875784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:04.878311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:04.878664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:04.879615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] PATH_INFO: `/v3/users/e9657e7a371540a788cbfc77cbd32340` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:04.885486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9657e7a371540a788cbfc77cbd32340)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:04.887499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:04.998231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9657e7a371540a788cbfc77cbd32340'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:04.999143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca17a4-9f2e-46f8-931b-3ec78824b279 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:05.000706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a5ca17a4-9f2e-46f8-931b-3ec78824b279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:05.016212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9657e7a371540a788cbfc77cbd32340'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:05.047513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9657e7a371540a788cbfc77cbd32340'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:05.079318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9657e7a371540a788cbfc77cbd32340'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:05.080223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0cb55906-c177-457a-854c-85ff5a1c24b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9657e7a371540a788cbfc77cbd32340'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:05.087877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 903/1802] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:04 2022] DELETE /identity/v3/users/e9657e7a371540a788cbfc77cbd32340 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:05.093479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49caf8-d989-47b4-85dd-04014a12b1d4 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:05.094383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49caf8-d989-47b4-85dd-04014a12b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:05.094716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b49caf8-d989-47b4-85dd-04014a12b1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:05.114094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca17a4-9f2e-46f8-931b-3ec78824b279 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:05.130571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6b49caf8-d989-47b4-85dd-04014a12b1d4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:05.132168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6b49caf8-d989-47b4-85dd-04014a12b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:05.222974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:05.224404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:05.225027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:05.225446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:05.231126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 904/1803] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:05.232890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:05.273511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49caf8-d989-47b4-85dd-04014a12b1d4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:05.275254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6b49caf8-d989-47b4-85dd-04014a12b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:05.350868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b49caf8-d989-47b4-85dd-04014a12b1d4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:05.354721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af1ece-91b3-46a5-acf0-20d490a18226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:05.355387 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af1ece-91b3-46a5-acf0-20d490a18226 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:05.356619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af1ece-91b3-46a5-acf0-20d490a18226 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:05.356901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af1ece-91b3-46a5-acf0-20d490a18226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:05.366076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:05.368323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:05.368732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af1ece-91b3-46a5-acf0-20d490a18226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:05.370429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af1ece-91b3-46a5-acf0-20d490a18226 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:05.382053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 905/1804] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:05.391704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 900/1805] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:05.995423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d24387-4e99-4581-8614-3809aab04e4f None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:05.995948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d24387-4e99-4581-8614-3809aab04e4f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:05.995948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d24387-4e99-4581-8614-3809aab04e4f None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:05.997799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 906/1806] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:41:05.998793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:06.004757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:06.024774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44750c-be2c-4b65-b1b7-32a79162a4b1 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:06.029939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:06.032011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5fab-e91e-4dd7-8fe2-f92d1a190b85 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:06.032620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5fab-e91e-4dd7-8fe2-f92d1a190b85 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:06.033091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5fab-e91e-4dd7-8fe2-f92d1a190b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:06.043573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:06.046990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:06.047534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] PATH_INFO: `/v3/projects/e99fbc7ebdd547969049e103b9064c17` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:06.049394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99fbc7ebdd547969049e103b9064c17)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:06.054477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:06.069249 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-85cf5fab-e91e-4dd7-8fe2-f92d1a190b85 None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:06.071279 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-85cf5fab-e91e-4dd7-8fe2-f92d1a190b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:06.179728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99fbc7ebdd547969049e103b9064c17', 'request_id': 'req-3877c2bb-749a-49fa-8492-2094c8036f49'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:06.210562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99fbc7ebdd547969049e103b9064c17', 'request_id': 'req-3877c2bb-749a-49fa-8492-2094c8036f49'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:06.223759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99fbc7ebdd547969049e103b9064c17', 'request_id': 'req-3877c2bb-749a-49fa-8492-2094c8036f49'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:06.248887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] The token cache is being invalidate because project e99fbc7ebdd547969049e103b9064c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:06.249452 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:06.250528 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3877c2bb-749a-49fa-8492-2094c8036f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:06.254678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 901/1807] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:05 2022] DELETE /identity/v3/projects/e99fbc7ebdd547969049e103b9064c17 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:06.255641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 907/1808] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:41:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:06.261034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52b22-0352-40d4-87b9-a43e42efdc30 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:06.261655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52b22-0352-40d4-87b9-a43e42efdc30 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:06.262227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52b22-0352-40d4-87b9-a43e42efdc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:06.305866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-55f52b22-0352-40d4-87b9-a43e42efdc30 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:06.307275 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-55f52b22-0352-40d4-87b9-a43e42efdc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:06.424491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 902/1809] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:06.430261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aef04-0629-4981-a14f-52afe0be54b1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:06.430859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aef04-0629-4981-a14f-52afe0be54b1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:06.431423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056aef04-0629-4981-a14f-52afe0be54b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:06.470415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-056aef04-0629-4981-a14f-52afe0be54b1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:06.472171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-056aef04-0629-4981-a14f-52afe0be54b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:06.501603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 908/1810] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:06.506963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f52b22-0352-40d4-87b9-a43e42efdc30 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:06.532481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f52b22-0352-40d4-87b9-a43e42efdc30 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:06.546013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398374-2eed-4412-917d-acf44b5a1342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:06.547221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398374-2eed-4412-917d-acf44b5a1342 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:06.547726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398374-2eed-4412-917d-acf44b5a1342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:06.548214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398374-2eed-4412-917d-acf44b5a1342 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:06.549349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45398374-2eed-4412-917d-acf44b5a1342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:06.550386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45398374-2eed-4412-917d-acf44b5a1342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:06.559561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45398374-2eed-4412-917d-acf44b5a1342 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:06.574086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aef04-0629-4981-a14f-52afe0be54b1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:06.576693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-056aef04-0629-4981-a14f-52afe0be54b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:06.607743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 903/1811] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:06.612215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398374-2eed-4412-917d-acf44b5a1342 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:06.640769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398374-2eed-4412-917d-acf44b5a1342 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:06.653307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb2bc-aeac-4b88-84a3-9fb58ecc066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:06.655722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb2bc-aeac-4b88-84a3-9fb58ecc066c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:06.656922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb2bc-aeac-4b88-84a3-9fb58ecc066c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:06.658149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cb2bc-aeac-4b88-84a3-9fb58ecc066c admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:06.660564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cb2bc-aeac-4b88-84a3-9fb58ecc066c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:06.663998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cb2bc-aeac-4b88-84a3-9fb58ecc066c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:06.744886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 904/1812] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:06 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:06.746051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb2bc-aeac-4b88-84a3-9fb58ecc066c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:06.750709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-730cb2bc-aeac-4b88-84a3-9fb58ecc066c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:06.808037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056aef04-0629-4981-a14f-52afe0be54b1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:06.896572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cb2bc-aeac-4b88-84a3-9fb58ecc066c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:06.902043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:06.902993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:06.903243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:06.903523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] PATH_INFO: `/v3/projects/0a289bbf18e14193a68b716d4f0150bf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:06.904816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a289bbf18e14193a68b716d4f0150bf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:06.908179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:06.967460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0761136-5234-4587-a592-52324f333c27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:06.968215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0761136-5234-4587-a592-52324f333c27 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:06.968538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0761136-5234-4587-a592-52324f333c27 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:06.968800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0761136-5234-4587-a592-52324f333c27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:06.977756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b0761136-5234-4587-a592-52324f333c27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:06.997867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0761136-5234-4587-a592-52324f333c27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:06.999273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0761136-5234-4587-a592-52324f333c27 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:07.003579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a289bbf18e14193a68b716d4f0150bf', 'request_id': 'req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.016832 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a289bbf18e14193a68b716d4f0150bf', 'request_id': 'req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.018229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 909/1813] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:07.019197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0761136-5234-4587-a592-52324f333c27 service nova] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:07.036771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0761136-5234-4587-a592-52324f333c27 service nova] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:07.038465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a289bbf18e14193a68b716d4f0150bf', 'request_id': 'req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.066386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] The token cache is being invalidate because project 0a289bbf18e14193a68b716d4f0150bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:07.066741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.067971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.070599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 905/1814] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:06 2022] DELETE /identity/v3/projects/0a289bbf18e14193a68b716d4f0150bf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:07.075060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:07.078211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:07.165215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b27c8-4073-4c66-b7bf-550bdbe3b3b8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:07.188280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:07.191143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:07.191466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:07.191745 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] PATH_INFO: `/v3/users/1e4fc3aa476d4c4da80695ab7c79df04` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:07.196506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e075f95-cc68-4275-912d-85009c5499ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:07.197195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e075f95-cc68-4275-912d-85009c5499ec admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:07.197479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e075f95-cc68-4275-912d-85009c5499ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:07.197756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e075f95-cc68-4275-912d-85009c5499ec admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:07.198734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e075f95-cc68-4275-912d-85009c5499ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:07.199584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4fc3aa476d4c4da80695ab7c79df04)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:07.211433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:07.212571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e075f95-cc68-4275-912d-85009c5499ec admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:07.252318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 910/1815] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:07 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:07.257095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e075f95-cc68-4275-912d-85009c5499ec admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:07.264885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7e075f95-cc68-4275-912d-85009c5499ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:07.284615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e075f95-cc68-4275-912d-85009c5499ec admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:07.294863 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb297d-0790-468a-aa6c-55ebfba2cdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:07.297654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb297d-0790-468a-aa6c-55ebfba2cdae admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:07.298333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb297d-0790-468a-aa6c-55ebfba2cdae admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:07.298877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb297d-0790-468a-aa6c-55ebfba2cdae admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:07.300174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb297d-0790-468a-aa6c-55ebfba2cdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:07.302788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb297d-0790-468a-aa6c-55ebfba2cdae admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:07.318004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4fc3aa476d4c4da80695ab7c79df04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.321201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 911/1816] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:07.325575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb297d-0790-468a-aa6c-55ebfba2cdae admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:07.333545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4fc3aa476d4c4da80695ab7c79df04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.357740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4fc3aa476d4c4da80695ab7c79df04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.358484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4fc3aa476d4c4da80695ab7c79df04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.360609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb297d-0790-468a-aa6c-55ebfba2cdae admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:07.368247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4fc3aa476d4c4da80695ab7c79df04'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:07.370610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c0c8e-e5b9-48ff-ac44-e9393ba74f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:07.371832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c0c8e-e5b9-48ff-ac44-e9393ba74f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:07.372393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c0c8e-e5b9-48ff-ac44-e9393ba74f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:07.372903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c0c8e-e5b9-48ff-ac44-e9393ba74f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:07.374022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c0c8e-e5b9-48ff-ac44-e9393ba74f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:07.375407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 906/1817] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:07 2022] DELETE /identity/v3/users/1e4fc3aa476d4c4da80695ab7c79df04 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:07.376945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c0c8e-e5b9-48ff-ac44-e9393ba74f27 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:07.390130 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 912/1818] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:07.395799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:07.398404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:07.480034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653334f6-6154-491e-8d17-20ba04448527 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:07.490823 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4903f2-0b68-4ac5-99c4-0401a35a4624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:07.494813 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4903f2-0b68-4ac5-99c4-0401a35a4624 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:07.495422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4903f2-0b68-4ac5-99c4-0401a35a4624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:07.495863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4903f2-0b68-4ac5-99c4-0401a35a4624 admin admin] PATH_INFO: `/v3/projects/20f57eaf014f4cf68e664b6f61b5a964/users/58b2a8d362a748afb4a50670a722d384/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:07.534831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4903f2-0b68-4ac5-99c4-0401a35a4624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f57eaf014f4cf68e664b6f61b5a964, user_id=58b2a8d362a748afb4a50670a722d384, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:07.537649 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4903f2-0b68-4ac5-99c4-0401a35a4624 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:07.561449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 907/1819] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:07 2022] PUT /identity/v3/projects/20f57eaf014f4cf68e664b6f61b5a964/users/58b2a8d362a748afb4a50670a722d384/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:07.578866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2de55-afcb-41c7-9a53-edd49336cdeb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:07.579762 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2de55-afcb-41c7-9a53-edd49336cdeb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:07.580154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2de55-afcb-41c7-9a53-edd49336cdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:07.652033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0ec2de55-afcb-41c7-9a53-edd49336cdeb None None] MFA Rules not processed for user `58b2a8d362a748afb4a50670a722d384`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:07.653322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0ec2de55-afcb-41c7-9a53-edd49336cdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:07.799816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4903f2-0b68-4ac5-99c4-0401a35a4624 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:07.800084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 913/1820] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:07.885267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4903f2-0b68-4ac5-99c4-0401a35a4624 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:07.891394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af599180-3c80-4762-ac92-8bf137bc96a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:07.892076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af599180-3c80-4762-ac92-8bf137bc96a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:07.892577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af599180-3c80-4762-ac92-8bf137bc96a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:07.893005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af599180-3c80-4762-ac92-8bf137bc96a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:07.893724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af599180-3c80-4762-ac92-8bf137bc96a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:07.896526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af599180-3c80-4762-ac92-8bf137bc96a9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:07.945116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 908/1821] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:07 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:07.950831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2de55-afcb-41c7-9a53-edd49336cdeb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:07.964920 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2de55-afcb-41c7-9a53-edd49336cdeb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:08.057939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c0d9-4168-44e1-b90d-245d6fffe6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:08.058707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c0d9-4168-44e1-b90d-245d6fffe6fe admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.060111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c0d9-4168-44e1-b90d-245d6fffe6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.060897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c0d9-4168-44e1-b90d-245d6fffe6fe admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.061810 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9c0d9-4168-44e1-b90d-245d6fffe6fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:08.067245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9c0d9-4168-44e1-b90d-245d6fffe6fe admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:08.104052 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 914/1822] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:07 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:08.105039 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af599180-3c80-4762-ac92-8bf137bc96a9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:08.125889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af599180-3c80-4762-ac92-8bf137bc96a9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:08.134659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4841-ffe9-45fe-a5b4-16c9c27f1238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:08.135794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4841-ffe9-45fe-a5b4-16c9c27f1238 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.136224 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4841-ffe9-45fe-a5b4-16c9c27f1238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.136849 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4841-ffe9-45fe-a5b4-16c9c27f1238 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.138491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea4841-ffe9-45fe-a5b4-16c9c27f1238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:08.141148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea4841-ffe9-45fe-a5b4-16c9c27f1238 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:08.157595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 909/1823] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:08.161983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c0d9-4168-44e1-b90d-245d6fffe6fe admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:08.182141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c0d9-4168-44e1-b90d-245d6fffe6fe admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:08.189157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131814-06a3-401b-8d8e-1f4ff2613636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:08.190307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131814-06a3-401b-8d8e-1f4ff2613636 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.190693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131814-06a3-401b-8d8e-1f4ff2613636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.191684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0131814-06a3-401b-8d8e-1f4ff2613636 admin admin] PATH_INFO: `/v3/projects/39353900043b46df8d289b91b89ef905/users/95baa943948444e987a387514030ff43/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.210350 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131814-06a3-401b-8d8e-1f4ff2613636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39353900043b46df8d289b91b89ef905, user_id=95baa943948444e987a387514030ff43, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:08.214152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0131814-06a3-401b-8d8e-1f4ff2613636 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:08.233811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4841-ffe9-45fe-a5b4-16c9c27f1238 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:08.244445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 915/1824] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:08 2022] PUT /identity/v3/projects/39353900043b46df8d289b91b89ef905/users/95baa943948444e987a387514030ff43/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:08.261742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4841-ffe9-45fe-a5b4-16c9c27f1238 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:08.406925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c19c4c-7850-4bda-8036-eedc87345638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:08.408292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c19c4c-7850-4bda-8036-eedc87345638 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.409021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c19c4c-7850-4bda-8036-eedc87345638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.410265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c19c4c-7850-4bda-8036-eedc87345638 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.411423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c19c4c-7850-4bda-8036-eedc87345638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:08.414193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c19c4c-7850-4bda-8036-eedc87345638 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:08.436374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 910/1825] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:08.440612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131814-06a3-401b-8d8e-1f4ff2613636 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:08.453509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0131814-06a3-401b-8d8e-1f4ff2613636 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:08.459020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213e8d0-2f03-48f8-85bf-bbae851637dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:08.460086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213e8d0-2f03-48f8-85bf-bbae851637dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.460574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213e8d0-2f03-48f8-85bf-bbae851637dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.461049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213e8d0-2f03-48f8-85bf-bbae851637dd admin admin] PATH_INFO: `/v3/projects/39353900043b46df8d289b91b89ef905/users/95baa943948444e987a387514030ff43/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.463188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213e8d0-2f03-48f8-85bf-bbae851637dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=39353900043b46df8d289b91b89ef905, user_id=95baa943948444e987a387514030ff43, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:08.466231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213e8d0-2f03-48f8-85bf-bbae851637dd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:08.475358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c19c4c-7850-4bda-8036-eedc87345638 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:08.477222 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-16c19c4c-7850-4bda-8036-eedc87345638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:08.482250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 916/1826] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:08 2022] PUT /identity/v3/projects/39353900043b46df8d289b91b89ef905/users/95baa943948444e987a387514030ff43/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:08.493357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914cae1-09fe-453e-8c2a-56421e8078f8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.494165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914cae1-09fe-453e-8c2a-56421e8078f8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.494165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914cae1-09fe-453e-8c2a-56421e8078f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.508749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c19c4c-7850-4bda-8036-eedc87345638 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:08.525900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2914cae1-09fe-453e-8c2a-56421e8078f8 None None] MFA Rules not processed for user `95baa943948444e987a387514030ff43`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:08.527737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2914cae1-09fe-453e-8c2a-56421e8078f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:08.587839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:08.588752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.589033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.589312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] PATH_INFO: `/v3/projects/c8a7af2a68604326b39adde6a509460d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.592335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a7af2a68604326b39adde6a509460d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:08.595873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:08.631218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 917/1827] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:08.642738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914cae1-09fe-453e-8c2a-56421e8078f8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:08.644383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2914cae1-09fe-453e-8c2a-56421e8078f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:08.671404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a7af2a68604326b39adde6a509460d', 'request_id': 'req-d7cfc10c-3526-4098-87c1-d38dbe610525'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:08.677714 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a7af2a68604326b39adde6a509460d', 'request_id': 'req-d7cfc10c-3526-4098-87c1-d38dbe610525'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:08.686018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a7af2a68604326b39adde6a509460d', 'request_id': 'req-d7cfc10c-3526-4098-87c1-d38dbe610525'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:08.701079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] The token cache is being invalidate because project c8a7af2a68604326b39adde6a509460d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:08.701371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:08.702017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7cfc10c-3526-4098-87c1-d38dbe610525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:08.703830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 911/1828] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:08 2022] DELETE /identity/v3/projects/c8a7af2a68604326b39adde6a509460d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:08.710788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe1e8-7f3d-4d7c-a997-44b5d200c8f2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.710958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914cae1-09fe-453e-8c2a-56421e8078f8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:08.711084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe1e8-7f3d-4d7c-a997-44b5d200c8f2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.711344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfe1e8-7f3d-4d7c-a997-44b5d200c8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.730011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-67dfe1e8-7f3d-4d7c-a997-44b5d200c8f2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:08.731226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-67dfe1e8-7f3d-4d7c-a997-44b5d200c8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:08.774574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b703cc3-b407-427e-99be-388ffb266183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:08.775132 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b703cc3-b407-427e-99be-388ffb266183 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.775418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b703cc3-b407-427e-99be-388ffb266183 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.775692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b703cc3-b407-427e-99be-388ffb266183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.778130 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0b703cc3-b407-427e-99be-388ffb266183 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:08.851093 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 912/1829] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:08.862711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259efd89-a73a-49a4-9c49-b432622c324c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.863218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259efd89-a73a-49a4-9c49-b432622c324c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.863964 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259efd89-a73a-49a4-9c49-b432622c324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.889575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b703cc3-b407-427e-99be-388ffb266183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:08.891641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b703cc3-b407-427e-99be-388ffb266183 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:08.891753 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-259efd89-a73a-49a4-9c49-b432622c324c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:08.892880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-259efd89-a73a-49a4-9c49-b432622c324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:08.904699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 913/1830] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:08.907059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259efd89-a73a-49a4-9c49-b432622c324c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:08.907445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 918/1831] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:08.931063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259efd89-a73a-49a4-9c49-b432622c324c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:08.939366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:08.939687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:08.940115 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:08.940692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:08.942130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:08.942569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:08.944478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:08.976585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 914/1832] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:41:08.981558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b703cc3-b407-427e-99be-388ffb266183 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:08.994263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b703cc3-b407-427e-99be-388ffb266183 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:09.026874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394392d-7616-4f5b-b8f8-af966892ecff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:09.027548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394392d-7616-4f5b-b8f8-af966892ecff admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:09.027822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394392d-7616-4f5b-b8f8-af966892ecff admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:09.028428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394392d-7616-4f5b-b8f8-af966892ecff admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:09.028837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394392d-7616-4f5b-b8f8-af966892ecff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:09.030732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394392d-7616-4f5b-b8f8-af966892ecff admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:09.069846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 919/1833] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:08 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:09.072940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:09.075409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:09.077837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394392d-7616-4f5b-b8f8-af966892ecff admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:09.094341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26a3d-6ee2-4dd6-b404-ee22502f7c77 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:09.182550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394392d-7616-4f5b-b8f8-af966892ecff admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:09.194211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa017230-a5a5-4b00-a14d-383fdbcf7240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:09.195294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa017230-a5a5-4b00-a14d-383fdbcf7240 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:09.195294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa017230-a5a5-4b00-a14d-383fdbcf7240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:09.195450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa017230-a5a5-4b00-a14d-383fdbcf7240 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:09.196149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa017230-a5a5-4b00-a14d-383fdbcf7240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:09.205676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa017230-a5a5-4b00-a14d-383fdbcf7240 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:09.216142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196a706-9f13-44ea-903a-b305586b88ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:09.217212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a706-9f13-44ea-903a-b305586b88ff service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:09.217757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a706-9f13-44ea-903a-b305586b88ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:09.218361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196a706-9f13-44ea-903a-b305586b88ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:09.220779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0196a706-9f13-44ea-903a-b305586b88ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:09.248483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 920/1834] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:09 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:09.253328 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa017230-a5a5-4b00-a14d-383fdbcf7240 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:09.276816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa017230-a5a5-4b00-a14d-383fdbcf7240 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:09.285294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a45229-f258-4cbb-b156-8138c82768ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:09.286758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a45229-f258-4cbb-b156-8138c82768ec admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:09.288613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a45229-f258-4cbb-b156-8138c82768ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:09.289225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a45229-f258-4cbb-b156-8138c82768ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:09.290324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a45229-f258-4cbb-b156-8138c82768ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:09.293903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a45229-f258-4cbb-b156-8138c82768ec admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:09.309089 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 921/1835] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:09.313546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a45229-f258-4cbb-b156-8138c82768ec admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:09.325956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a45229-f258-4cbb-b156-8138c82768ec admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:09.332128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993d92-1760-4517-8ef1-706ee65dcbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:09.333188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993d92-1760-4517-8ef1-706ee65dcbfe admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:09.333564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993d92-1760-4517-8ef1-706ee65dcbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:09.333946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993d92-1760-4517-8ef1-706ee65dcbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:09.334813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993d92-1760-4517-8ef1-706ee65dcbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:09.338240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993d92-1760-4517-8ef1-706ee65dcbfe admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:09.345234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196a706-9f13-44ea-903a-b305586b88ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:09.346685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196a706-9f13-44ea-903a-b305586b88ff service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:09.351289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 922/1836] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:09.356132 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993d92-1760-4517-8ef1-706ee65dcbfe admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:09.365383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 915/1837] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:09.384496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993d92-1760-4517-8ef1-706ee65dcbfe admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:09.393745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f42669-76cf-4f87-b79d-fbb6b664e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:09.396195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f42669-76cf-4f87-b79d-fbb6b664e79e admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:09.397639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f42669-76cf-4f87-b79d-fbb6b664e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:09.397953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f42669-76cf-4f87-b79d-fbb6b664e79e admin admin] PATH_INFO: `/v3/projects/f34e66a328804e2b9aafa429d4baa03d/users/f57288c4aaa3409299acf5a49c6bd94b/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:09.448264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f42669-76cf-4f87-b79d-fbb6b664e79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34e66a328804e2b9aafa429d4baa03d, user_id=f57288c4aaa3409299acf5a49c6bd94b, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:09.464624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f42669-76cf-4f87-b79d-fbb6b664e79e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:09.495274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 923/1838] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:09 2022] PUT /identity/v3/projects/f34e66a328804e2b9aafa429d4baa03d/users/f57288c4aaa3409299acf5a49c6bd94b/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:09.508576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f91c3-6d75-41ca-821c-cd97e3ac8a92 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:09.508706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f91c3-6d75-41ca-821c-cd97e3ac8a92 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:09.509220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f91c3-6d75-41ca-821c-cd97e3ac8a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:09.573556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-828f91c3-6d75-41ca-821c-cd97e3ac8a92 None None] MFA Rules not processed for user `f57288c4aaa3409299acf5a49c6bd94b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:09.579712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-828f91c3-6d75-41ca-821c-cd97e3ac8a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:09.723323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 916/1839] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:09.736226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f42669-76cf-4f87-b79d-fbb6b664e79e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:09.738067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a1f42669-76cf-4f87-b79d-fbb6b664e79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:09.825755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f42669-76cf-4f87-b79d-fbb6b664e79e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:09.829778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e9c2-6e8b-4d15-ab15-5500c78f1e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:09.830560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e9c2-6e8b-4d15-ab15-5500c78f1e00 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:09.830966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e9c2-6e8b-4d15-ab15-5500c78f1e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:09.831294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e9c2-6e8b-4d15-ab15-5500c78f1e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:09.841331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301e9c2-6e8b-4d15-ab15-5500c78f1e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:09.842847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301e9c2-6e8b-4d15-ab15-5500c78f1e00 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:09.854084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 924/1840] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:14.997875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f91c3-6d75-41ca-821c-cd97e3ac8a92 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:15.077960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f91c3-6d75-41ca-821c-cd97e3ac8a92 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:15.083498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:15.084392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:15.084725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:15.085013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] PATH_INFO: `/v3/users/f57288c4aaa3409299acf5a49c6bd94b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:15.086279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57288c4aaa3409299acf5a49c6bd94b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:15.088283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:15.134383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57288c4aaa3409299acf5a49c6bd94b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.141081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57288c4aaa3409299acf5a49c6bd94b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.154635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57288c4aaa3409299acf5a49c6bd94b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.155344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57288c4aaa3409299acf5a49c6bd94b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.163003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57288c4aaa3409299acf5a49c6bd94b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.171937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 917/1841] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:14 2022] DELETE /identity/v3/users/f57288c4aaa3409299acf5a49c6bd94b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:15.173695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec58743-4c56-4185-98de-e682cec14892 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:15.174163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec58743-4c56-4185-98de-e682cec14892 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:15.174278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec58743-4c56-4185-98de-e682cec14892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:15.192630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4ec58743-4c56-4185-98de-e682cec14892 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:15.193829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4ec58743-4c56-4185-98de-e682cec14892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:15.251889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 925/1842] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:15.262521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:15.264000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:15.320928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1dbfd-190c-41aa-ae76-6c45f388579f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:15.324919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb561e-3fb0-474e-9542-8c5e9e2967d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:15.325563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb561e-3fb0-474e-9542-8c5e9e2967d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:15.325880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb561e-3fb0-474e-9542-8c5e9e2967d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:15.326157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb561e-3fb0-474e-9542-8c5e9e2967d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:15.335629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb561e-3fb0-474e-9542-8c5e9e2967d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:15.337102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb561e-3fb0-474e-9542-8c5e9e2967d7 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:15.348855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 918/1843] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:15.607961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec58743-4c56-4185-98de-e682cec14892 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:15.609473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4ec58743-4c56-4185-98de-e682cec14892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:15.627935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec58743-4c56-4185-98de-e682cec14892 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:15.635475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:15.636503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:15.636852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:15.637198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] PATH_INFO: `/v3/projects/f34e66a328804e2b9aafa429d4baa03d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:15.638681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34e66a328804e2b9aafa429d4baa03d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:15.641042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:15.688000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34e66a328804e2b9aafa429d4baa03d', 'request_id': 'req-1e9d62b2-426a-407d-8c0c-50237ac8f437'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.694932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34e66a328804e2b9aafa429d4baa03d', 'request_id': 'req-1e9d62b2-426a-407d-8c0c-50237ac8f437'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.703054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34e66a328804e2b9aafa429d4baa03d', 'request_id': 'req-1e9d62b2-426a-407d-8c0c-50237ac8f437'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.713499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] The token cache is being invalidate because project f34e66a328804e2b9aafa429d4baa03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:15.713782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.714425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e9d62b2-426a-407d-8c0c-50237ac8f437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:15.715971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 926/1844] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:15 2022] DELETE /identity/v3/projects/f34e66a328804e2b9aafa429d4baa03d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:15.721984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9f490-3080-45e8-a003-6ceb87719dfb None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:15.722270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9f490-3080-45e8-a003-6ceb87719dfb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:15.722542 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9f490-3080-45e8-a003-6ceb87719dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:15.741457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-42b9f490-3080-45e8-a003-6ceb87719dfb None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:15.742725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-42b9f490-3080-45e8-a003-6ceb87719dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:15.804874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 919/1845] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:15.812555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e087c2-f435-4aea-b8bb-4da465d0cfaf None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:15.812865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e087c2-f435-4aea-b8bb-4da465d0cfaf None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:15.813145 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e087c2-f435-4aea-b8bb-4da465d0cfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:15.832114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a3e087c2-f435-4aea-b8bb-4da465d0cfaf None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:15.834135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a3e087c2-f435-4aea-b8bb-4da465d0cfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:15.842138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 927/1846] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:15.846526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9f490-3080-45e8-a003-6ceb87719dfb None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:15.855993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9f490-3080-45e8-a003-6ceb87719dfb None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:15.860537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993bdea-ea1f-41e1-9d1c-5d3b864bef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:15.861196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993bdea-ea1f-41e1-9d1c-5d3b864bef9d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:15.861478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993bdea-ea1f-41e1-9d1c-5d3b864bef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:15.861755 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993bdea-ea1f-41e1-9d1c-5d3b864bef9d admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:15.862492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993bdea-ea1f-41e1-9d1c-5d3b864bef9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:15.862798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993bdea-ea1f-41e1-9d1c-5d3b864bef9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:15.865008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993bdea-ea1f-41e1-9d1c-5d3b864bef9d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:15.876670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 920/1847] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:15.881885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e087c2-f435-4aea-b8bb-4da465d0cfaf None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:15.891134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e087c2-f435-4aea-b8bb-4da465d0cfaf None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:15.895794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e15d-f1eb-4993-afed-aab4c4b0ce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:15.896494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e15d-f1eb-4993-afed-aab4c4b0ce7b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:15.896771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e15d-f1eb-4993-afed-aab4c4b0ce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:15.897047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530e15d-f1eb-4993-afed-aab4c4b0ce7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:15.897741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530e15d-f1eb-4993-afed-aab4c4b0ce7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:15.899627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530e15d-f1eb-4993-afed-aab4c4b0ce7b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:15.924185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 928/1848] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:15 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:15.929153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993bdea-ea1f-41e1-9d1c-5d3b864bef9d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:15.939211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993bdea-ea1f-41e1-9d1c-5d3b864bef9d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:15.995019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2f8fe-6634-4b89-a5f6-0483187d9f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:15.995683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2f8fe-6634-4b89-a5f6-0483187d9f3b admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:15.995965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2f8fe-6634-4b89-a5f6-0483187d9f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:15.996254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2f8fe-6634-4b89-a5f6-0483187d9f3b admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:15.996976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2f8fe-6634-4b89-a5f6-0483187d9f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:15.998901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2f8fe-6634-4b89-a5f6-0483187d9f3b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:16.021660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 921/1849] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:15 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:16.025253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e15d-f1eb-4993-afed-aab4c4b0ce7b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:16.036228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530e15d-f1eb-4993-afed-aab4c4b0ce7b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:16.041067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e9a89-0f07-4b34-a2cd-25e64d6893f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:16.041973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e9a89-0f07-4b34-a2cd-25e64d6893f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:16.042259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e9a89-0f07-4b34-a2cd-25e64d6893f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:16.042538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e9a89-0f07-4b34-a2cd-25e64d6893f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:16.043279 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e9a89-0f07-4b34-a2cd-25e64d6893f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:16.045060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e9a89-0f07-4b34-a2cd-25e64d6893f8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:16.055925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 929/1850] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:16.060100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2f8fe-6634-4b89-a5f6-0483187d9f3b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:16.075420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2f8fe-6634-4b89-a5f6-0483187d9f3b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:16.080777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fb4e6-a56e-4de3-bd73-f2e146738a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:16.081450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb4e6-a56e-4de3-bd73-f2e146738a3c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:16.081733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb4e6-a56e-4de3-bd73-f2e146738a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:16.082009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb4e6-a56e-4de3-bd73-f2e146738a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:16.083370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fb4e6-a56e-4de3-bd73-f2e146738a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:16.085514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fb4e6-a56e-4de3-bd73-f2e146738a3c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:16.095452 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 922/1851] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:16.101102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e9a89-0f07-4b34-a2cd-25e64d6893f8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:16.112965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e9a89-0f07-4b34-a2cd-25e64d6893f8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:16.117858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dde53-11a3-401f-83e5-18805e134f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:16.118744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dde53-11a3-401f-83e5-18805e134f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:16.119032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dde53-11a3-401f-83e5-18805e134f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:16.119299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dde53-11a3-401f-83e5-18805e134f44 admin admin] PATH_INFO: `/v3/projects/3fc0370b223844be80a680de68d7980d/users/b88790a080ea48ec89862bde682e550a/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:16.134274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dde53-11a3-401f-83e5-18805e134f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc0370b223844be80a680de68d7980d, user_id=b88790a080ea48ec89862bde682e550a, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:16.136936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dde53-11a3-401f-83e5-18805e134f44 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:16.150024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 930/1852] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:16 2022] PUT /identity/v3/projects/3fc0370b223844be80a680de68d7980d/users/b88790a080ea48ec89862bde682e550a/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:16.161530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ced09-3d57-495d-b5d2-28dd4f887eab None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:16.161817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ced09-3d57-495d-b5d2-28dd4f887eab None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:16.162094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ced09-3d57-495d-b5d2-28dd4f887eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:16.188635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9c9ced09-3d57-495d-b5d2-28dd4f887eab None None] MFA Rules not processed for user `b88790a080ea48ec89862bde682e550a`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:16.189830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9c9ced09-3d57-495d-b5d2-28dd4f887eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:16.251039 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 923/1853] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:16.262733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dde53-11a3-401f-83e5-18805e134f44 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:16.264618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ee8dde53-11a3-401f-83e5-18805e134f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:16.319652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dde53-11a3-401f-83e5-18805e134f44 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:16.323541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f755e-0122-46d9-8ff0-255937f0fbcc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '612a02fb42af490abcba0e75ec8c759f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:16.324180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f755e-0122-46d9-8ff0-255937f0fbcc service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:16.324488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f755e-0122-46d9-8ff0-255937f0fbcc service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:16.324763 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f755e-0122-46d9-8ff0-255937f0fbcc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:16.333661 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f755e-0122-46d9-8ff0-255937f0fbcc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:16.335094 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f755e-0122-46d9-8ff0-255937f0fbcc service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:16.343635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 931/1854] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:20.149612 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ced09-3d57-495d-b5d2-28dd4f887eab None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:20.151116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9c9ced09-3d57-495d-b5d2-28dd4f887eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:20.231257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ced09-3d57-495d-b5d2-28dd4f887eab None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:20.246230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:20.247299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:20.247761 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:20.248108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] PATH_INFO: `/v3/users/6a6283063de943d5aaa9cccce65525da` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:20.249510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6283063de943d5aaa9cccce65525da)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:20.251547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:20.302314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6283063de943d5aaa9cccce65525da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:20.310554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6283063de943d5aaa9cccce65525da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:20.323436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6283063de943d5aaa9cccce65525da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:20.324302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6283063de943d5aaa9cccce65525da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:20.341243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6283063de943d5aaa9cccce65525da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:20.347586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 924/1855] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:20 2022] DELETE /identity/v3/users/6a6283063de943d5aaa9cccce65525da => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:20.352532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b90660-026b-49ae-8d50-d2ae5bdc2c16 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:20.353025 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b90660-026b-49ae-8d50-d2ae5bdc2c16 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:20.353135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b90660-026b-49ae-8d50-d2ae5bdc2c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:20.370935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-22b90660-026b-49ae-8d50-d2ae5bdc2c16 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:20.372127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-22b90660-026b-49ae-8d50-d2ae5bdc2c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:20.432712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 932/1856] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:20.442028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:20.443534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:20.508504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd29911-2b7e-41b2-81fb-99ff61dca0e0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:20.512829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acb83e-3a9d-4905-adfc-1770dfdf3574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:20.513560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acb83e-3a9d-4905-adfc-1770dfdf3574 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:20.513910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acb83e-3a9d-4905-adfc-1770dfdf3574 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:20.514364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acb83e-3a9d-4905-adfc-1770dfdf3574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:20.526146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acb83e-3a9d-4905-adfc-1770dfdf3574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:20.527583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acb83e-3a9d-4905-adfc-1770dfdf3574 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:20.538678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 925/1857] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:20.942882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b90660-026b-49ae-8d50-d2ae5bdc2c16 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:20.945834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-22b90660-026b-49ae-8d50-d2ae5bdc2c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:20.967011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b90660-026b-49ae-8d50-d2ae5bdc2c16 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:20.971898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:20.972855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:20.973136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:20.973409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] PATH_INFO: `/v3/projects/199396bfc5a94bf9bc3a62d3f1edcffe` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:20.975740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=199396bfc5a94bf9bc3a62d3f1edcffe)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:20.977792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:21.038710 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199396bfc5a94bf9bc3a62d3f1edcffe', 'request_id': 'req-88a73d10-8c49-4b95-9c8a-51c1de899813'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.045173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199396bfc5a94bf9bc3a62d3f1edcffe', 'request_id': 'req-88a73d10-8c49-4b95-9c8a-51c1de899813'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.054009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199396bfc5a94bf9bc3a62d3f1edcffe', 'request_id': 'req-88a73d10-8c49-4b95-9c8a-51c1de899813'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.065555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] The token cache is being invalidate because project 199396bfc5a94bf9bc3a62d3f1edcffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:21.065910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.067909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.076643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 933/1858] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:20 2022] DELETE /identity/v3/projects/199396bfc5a94bf9bc3a62d3f1edcffe => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:21.077833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acb83e-3a9d-4905-adfc-1770dfdf3574 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:21.088872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acb83e-3a9d-4905-adfc-1770dfdf3574 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:21.161758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:21.162628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:21.163072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:21.163343 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] PATH_INFO: `/v3/users/e6fe002dcb3f4a189d3bce5ac871891a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:21.164586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fe002dcb3f4a189d3bce5ac871891a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:21.166475 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:21.223028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fe002dcb3f4a189d3bce5ac871891a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.230569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fe002dcb3f4a189d3bce5ac871891a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.243609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fe002dcb3f4a189d3bce5ac871891a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.245136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fe002dcb3f4a189d3bce5ac871891a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.260890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fe002dcb3f4a189d3bce5ac871891a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.280444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 926/1859] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:21 2022] DELETE /identity/v3/users/e6fe002dcb3f4a189d3bce5ac871891a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:21.628063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:21.630368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:21.677691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a73d10-8c49-4b95-9c8a-51c1de899813 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:21.794520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:21.796103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:21.823302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:21.824302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:21.824709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:21.825088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] PATH_INFO: `/v3/projects/39608f5c83a44114be0f311f65b18b4e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:21.827884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39608f5c83a44114be0f311f65b18b4e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:21.831456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:21.920858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e7527-07d9-4ed9-bfe5-12f222806b66 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:21.923861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39608f5c83a44114be0f311f65b18b4e', 'request_id': 'req-a31acdca-f6a4-4dab-a884-3fd4be53e71f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.930662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39608f5c83a44114be0f311f65b18b4e', 'request_id': 'req-a31acdca-f6a4-4dab-a884-3fd4be53e71f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.942240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39608f5c83a44114be0f311f65b18b4e', 'request_id': 'req-a31acdca-f6a4-4dab-a884-3fd4be53e71f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.960669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] The token cache is being invalidate because project 39608f5c83a44114be0f311f65b18b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:21.961077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.961945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a31acdca-f6a4-4dab-a884-3fd4be53e71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:21.963686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 934/1860] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:21 2022] DELETE /identity/v3/projects/39608f5c83a44114be0f311f65b18b4e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:21.969263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960c6ef-157f-4a8f-b6a7-52b63a6f9c53 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:21.969772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960c6ef-157f-4a8f-b6a7-52b63a6f9c53 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:21.970061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960c6ef-157f-4a8f-b6a7-52b63a6f9c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:21.998095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0960c6ef-157f-4a8f-b6a7-52b63a6f9c53 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:21.999616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0960c6ef-157f-4a8f-b6a7-52b63a6f9c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:22.004418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.005302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.005599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.005872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] PATH_INFO: `/v3/users/58b2a8d362a748afb4a50670a722d384` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.007230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b2a8d362a748afb4a50670a722d384)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.008633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 935/1861] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:22.013424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.016161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735e2c8-b47e-4b59-bed5-93f3fa73e975 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.017598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735e2c8-b47e-4b59-bed5-93f3fa73e975 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.017935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735e2c8-b47e-4b59-bed5-93f3fa73e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.042517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7735e2c8-b47e-4b59-bed5-93f3fa73e975 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:22.043728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7735e2c8-b47e-4b59-bed5-93f3fa73e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:22.057981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 936/1862] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:22.059135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735e2c8-b47e-4b59-bed5-93f3fa73e975 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.068855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735e2c8-b47e-4b59-bed5-93f3fa73e975 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.074890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3938f-3b78-4850-9755-0b7bb6e8267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.075583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3938f-3b78-4850-9755-0b7bb6e8267a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.076008 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3938f-3b78-4850-9755-0b7bb6e8267a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.076279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b2a8d362a748afb4a50670a722d384'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:22.076410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3938f-3b78-4850-9755-0b7bb6e8267a admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.077081 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3938f-3b78-4850-9755-0b7bb6e8267a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:22.079026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3938f-3b78-4850-9755-0b7bb6e8267a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.079221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3938f-3b78-4850-9755-0b7bb6e8267a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.089911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b2a8d362a748afb4a50670a722d384'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:22.097343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 937/1863] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:22.099589 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3938f-3b78-4850-9755-0b7bb6e8267a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.107690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b2a8d362a748afb4a50670a722d384'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:22.108710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b2a8d362a748afb4a50670a722d384'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:22.117176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3938f-3b78-4850-9755-0b7bb6e8267a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.119759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ea53a93f-ee49-4ea6-bdd5-813a4fb5eaba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b2a8d362a748afb4a50670a722d384'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:22.125239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9955-97df-4f94-99b6-5b3b6c86b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.125905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9955-97df-4f94-99b6-5b3b6c86b99a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.126243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9955-97df-4f94-99b6-5b3b6c86b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.126518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9955-97df-4f94-99b6-5b3b6c86b99a admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.126614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 927/1864] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:21 2022] DELETE /identity/v3/users/58b2a8d362a748afb4a50670a722d384 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:22.127224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab9955-97df-4f94-99b6-5b3b6c86b99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.129248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab9955-97df-4f94-99b6-5b3b6c86b99a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.130997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c401-ff18-4eac-a518-f63766a9774e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.131353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c401-ff18-4eac-a518-f63766a9774e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.131857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c401-ff18-4eac-a518-f63766a9774e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.149967 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0cc4c401-ff18-4eac-a518-f63766a9774e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:22.151218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0cc4c401-ff18-4eac-a518-f63766a9774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:22.158710 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 938/1865] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:22 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:22.163394 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9955-97df-4f94-99b6-5b3b6c86b99a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.165205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-77ab9955-97df-4f94-99b6-5b3b6c86b99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:22.221736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 928/1866] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:22.232305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4c401-ff18-4eac-a518-f63766a9774e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.233978 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0cc4c401-ff18-4eac-a518-f63766a9774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:22.250552 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9955-97df-4f94-99b6-5b3b6c86b99a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.257371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506e374-8cd5-4c49-b9d9-abb49ef3872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.258061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506e374-8cd5-4c49-b9d9-abb49ef3872a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.258343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506e374-8cd5-4c49-b9d9-abb49ef3872a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.258617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506e374-8cd5-4c49-b9d9-abb49ef3872a admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.259332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506e374-8cd5-4c49-b9d9-abb49ef3872a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.261321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506e374-8cd5-4c49-b9d9-abb49ef3872a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.283636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 939/1867] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:22 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:22.287823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506e374-8cd5-4c49-b9d9-abb49ef3872a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.299513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506e374-8cd5-4c49-b9d9-abb49ef3872a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.304701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d9fdc-5dc5-41c8-ba13-729d522eeb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.305120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d9fdc-5dc5-41c8-ba13-729d522eeb2a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.305405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d9fdc-5dc5-41c8-ba13-729d522eeb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.305680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d9fdc-5dc5-41c8-ba13-729d522eeb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.306465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d9fdc-5dc5-41c8-ba13-729d522eeb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.307430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4c401-ff18-4eac-a518-f63766a9774e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.308060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d9fdc-5dc5-41c8-ba13-729d522eeb2a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.320631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 940/1868] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:22.324945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d9fdc-5dc5-41c8-ba13-729d522eeb2a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.340152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d9fdc-5dc5-41c8-ba13-729d522eeb2a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.345774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dd695-2a10-433c-b8da-135a276fb442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.346391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dd695-2a10-433c-b8da-135a276fb442 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.346858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dd695-2a10-433c-b8da-135a276fb442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.347179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dd695-2a10-433c-b8da-135a276fb442 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.348898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dd695-2a10-433c-b8da-135a276fb442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.350598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dd695-2a10-433c-b8da-135a276fb442 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.361217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 941/1869] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:22.365642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dd695-2a10-433c-b8da-135a276fb442 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.369291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8397737-47ee-4791-a797-8c732518a609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.370133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8397737-47ee-4791-a797-8c732518a609 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.370418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8397737-47ee-4791-a797-8c732518a609 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.370694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8397737-47ee-4791-a797-8c732518a609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.375324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dd695-2a10-433c-b8da-135a276fb442 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.380635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8397737-47ee-4791-a797-8c732518a609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.381101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78466288-8f79-4386-98cf-f7af3412be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.381976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78466288-8f79-4386-98cf-f7af3412be31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.382144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8397737-47ee-4791-a797-8c732518a609 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.382282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78466288-8f79-4386-98cf-f7af3412be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.382521 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78466288-8f79-4386-98cf-f7af3412be31 admin admin] PATH_INFO: `/v3/projects/dfb60f83f96341c69ee5edea1b349598/users/21129c36ae8e47d38b706d8ae2b48b8f/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.393067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 929/1870] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:22.398383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78466288-8f79-4386-98cf-f7af3412be31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb60f83f96341c69ee5edea1b349598, user_id=21129c36ae8e47d38b706d8ae2b48b8f, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.401113 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78466288-8f79-4386-98cf-f7af3412be31 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.432467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 942/1871] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:22 2022] PUT /identity/v3/projects/dfb60f83f96341c69ee5edea1b349598/users/21129c36ae8e47d38b706d8ae2b48b8f/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:22.443226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723184bf-1c44-4d4f-8cc5-0b643bc4faf1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.443519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723184bf-1c44-4d4f-8cc5-0b643bc4faf1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.443803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723184bf-1c44-4d4f-8cc5-0b643bc4faf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.486916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-723184bf-1c44-4d4f-8cc5-0b643bc4faf1 None None] MFA Rules not processed for user `21129c36ae8e47d38b706d8ae2b48b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:22.489203 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-723184bf-1c44-4d4f-8cc5-0b643bc4faf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:22.584707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 930/1872] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:22.588655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78466288-8f79-4386-98cf-f7af3412be31 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.690551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78466288-8f79-4386-98cf-f7af3412be31 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.696114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164a62-2900-4e99-ad1a-1dd0abeecfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.696849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164a62-2900-4e99-ad1a-1dd0abeecfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.697133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164a62-2900-4e99-ad1a-1dd0abeecfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.697404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164a62-2900-4e99-ad1a-1dd0abeecfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.698375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164a62-2900-4e99-ad1a-1dd0abeecfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.700937 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164a62-2900-4e99-ad1a-1dd0abeecfc7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.740262 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 943/1873] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:22 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:22.744240 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723184bf-1c44-4d4f-8cc5-0b643bc4faf1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.758514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723184bf-1c44-4d4f-8cc5-0b643bc4faf1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.793622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164a62-2900-4e99-ad1a-1dd0abeecfc7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.798269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ed164a62-2900-4e99-ad1a-1dd0abeecfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:22.869590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f3bc1-a0b5-48dd-a8c5-4d105d50b297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.870462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f3bc1-a0b5-48dd-a8c5-4d105d50b297 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.870845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f3bc1-a0b5-48dd-a8c5-4d105d50b297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.871227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f3bc1-a0b5-48dd-a8c5-4d105d50b297 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.872055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f3bc1-a0b5-48dd-a8c5-4d105d50b297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.874301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f3bc1-a0b5-48dd-a8c5-4d105d50b297 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.909642 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 931/1874] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:22 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:22.913785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f3bc1-a0b5-48dd-a8c5-4d105d50b297 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.915223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164a62-2900-4e99-ad1a-1dd0abeecfc7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.922219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.923370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.923822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.924470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] PATH_INFO: `/v3/projects/20f57eaf014f4cf68e664b6f61b5a964` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.925043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f3bc1-a0b5-48dd-a8c5-4d105d50b297 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.926488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f57eaf014f4cf68e664b6f61b5a964)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.930079 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.930707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4845f-9bc1-48ab-9e56-2b18c6eea782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.931501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4845f-9bc1-48ab-9e56-2b18c6eea782 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.931887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4845f-9bc1-48ab-9e56-2b18c6eea782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.933365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4845f-9bc1-48ab-9e56-2b18c6eea782 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:22.933365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4845f-9bc1-48ab-9e56-2b18c6eea782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:22.934828 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4845f-9bc1-48ab-9e56-2b18c6eea782 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:22.945830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 932/1875] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:22.952403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4845f-9bc1-48ab-9e56-2b18c6eea782 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:22.967164 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4845f-9bc1-48ab-9e56-2b18c6eea782 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:22.978938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c531b5c-7bf4-42c2-a41a-204ea69b90da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:22.980117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c531b5c-7bf4-42c2-a41a-204ea69b90da admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:22.980304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c531b5c-7bf4-42c2-a41a-204ea69b90da admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:22.980640 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c531b5c-7bf4-42c2-a41a-204ea69b90da admin admin] PATH_INFO: `/v3/projects/687f2d33eb2d4c73ad2a7e69ed2b9c39/users/8196f21367d44ae494d5d10f4586e124/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:23.024400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c531b5c-7bf4-42c2-a41a-204ea69b90da admin admin] RBAC: Authorizing `identity:create_grant(project_id=687f2d33eb2d4c73ad2a7e69ed2b9c39, user_id=8196f21367d44ae494d5d10f4586e124, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:23.029912 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c531b5c-7bf4-42c2-a41a-204ea69b90da admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:23.031283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f57eaf014f4cf68e664b6f61b5a964', 'request_id': 'req-3eb3f9d5-acf3-41da-8b56-54f01a23665a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.047788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f57eaf014f4cf68e664b6f61b5a964', 'request_id': 'req-3eb3f9d5-acf3-41da-8b56-54f01a23665a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.055242 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 933/1876] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:22 2022] PUT /identity/v3/projects/687f2d33eb2d4c73ad2a7e69ed2b9c39/users/8196f21367d44ae494d5d10f4586e124/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:23.056805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c531b5c-7bf4-42c2-a41a-204ea69b90da admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:23.068454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f57eaf014f4cf68e664b6f61b5a964', 'request_id': 'req-3eb3f9d5-acf3-41da-8b56-54f01a23665a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.086734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] The token cache is being invalidate because project 20f57eaf014f4cf68e664b6f61b5a964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:23.087088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.087773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.092261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 944/1877] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:22 2022] DELETE /identity/v3/projects/20f57eaf014f4cf68e664b6f61b5a964 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:23.096725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:23.100769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:23.136677 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c531b5c-7bf4-42c2-a41a-204ea69b90da admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:23.148567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952018ae-f902-42f5-86d9-a85ca5f9b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:23.149363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952018ae-f902-42f5-86d9-a85ca5f9b73c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:23.149794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952018ae-f902-42f5-86d9-a85ca5f9b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:23.150578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952018ae-f902-42f5-86d9-a85ca5f9b73c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:23.152299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952018ae-f902-42f5-86d9-a85ca5f9b73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:23.154095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952018ae-f902-42f5-86d9-a85ca5f9b73c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:23.169259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 934/1878] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:23.173331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952018ae-f902-42f5-86d9-a85ca5f9b73c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:23.178110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-952018ae-f902-42f5-86d9-a85ca5f9b73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:23.200686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952018ae-f902-42f5-86d9-a85ca5f9b73c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:23.209688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1ddd8-b3b3-43a2-8ced-ae10bfe1f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:23.210282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1ddd8-b3b3-43a2-8ced-ae10bfe1f280 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:23.210711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1ddd8-b3b3-43a2-8ced-ae10bfe1f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:23.211090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1ddd8-b3b3-43a2-8ced-ae10bfe1f280 admin admin] PATH_INFO: `/v3/projects/687f2d33eb2d4c73ad2a7e69ed2b9c39/users/8196f21367d44ae494d5d10f4586e124/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:23.213912 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1ddd8-b3b3-43a2-8ced-ae10bfe1f280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=687f2d33eb2d4c73ad2a7e69ed2b9c39, user_id=8196f21367d44ae494d5d10f4586e124, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:23.217336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1ddd8-b3b3-43a2-8ced-ae10bfe1f280 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:23.275667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 935/1879] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:23 2022] PUT /identity/v3/projects/687f2d33eb2d4c73ad2a7e69ed2b9c39/users/8196f21367d44ae494d5d10f4586e124/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:23.288143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe14ee-6733-4f21-a03c-1e3d5661db4a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:23.288459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe14ee-6733-4f21-a03c-1e3d5661db4a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:23.288733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe14ee-6733-4f21-a03c-1e3d5661db4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:23.351069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0ffe14ee-6733-4f21-a03c-1e3d5661db4a None None] MFA Rules not processed for user `8196f21367d44ae494d5d10f4586e124`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:23.352314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0ffe14ee-6733-4f21-a03c-1e3d5661db4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:23.359663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3f9d5-acf3-41da-8b56-54f01a23665a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:23.466429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 936/1880] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:23.480908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:23.483271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe14ee-6733-4f21-a03c-1e3d5661db4a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:23.485135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0ffe14ee-6733-4f21-a03c-1e3d5661db4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:23.486867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:23.487147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:23.487418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] PATH_INFO: `/v3/users/95baa943948444e987a387514030ff43` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:23.489569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95baa943948444e987a387514030ff43)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:23.497963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:23.602191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe14ee-6733-4f21-a03c-1e3d5661db4a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:23.602403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95baa943948444e987a387514030ff43'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.610130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d1879-ef0d-4050-bd54-3a545e2543c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:23.611669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d1879-ef0d-4050-bd54-3a545e2543c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:23.612167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d1879-ef0d-4050-bd54-3a545e2543c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:23.612808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d1879-ef0d-4050-bd54-3a545e2543c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:23.617275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95baa943948444e987a387514030ff43'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.631445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d1879-ef0d-4050-bd54-3a545e2543c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:23.635486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d1879-ef0d-4050-bd54-3a545e2543c2 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:23.635672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95baa943948444e987a387514030ff43'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.658907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 937/1881] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:23.683003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95baa943948444e987a387514030ff43'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.684649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95baa943948444e987a387514030ff43'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:23.692010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 945/1882] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:23 2022] DELETE /identity/v3/users/95baa943948444e987a387514030ff43 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:24.103323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d1879-ef0d-4050-bd54-3a545e2543c2 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:24.115706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d1879-ef0d-4050-bd54-3a545e2543c2 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:24.215316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882fc9-b392-408a-bf74-4ea2f1428020 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8196f21367d44ae494d5d10f4586e124', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '687f2d33eb2d4c73ad2a7e69ed2b9c39', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:24.215991 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882fc9-b392-408a-bf74-4ea2f1428020 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:24.216301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882fc9-b392-408a-bf74-4ea2f1428020 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:24.216856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882fc9-b392-408a-bf74-4ea2f1428020 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:24.217622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882fc9-b392-408a-bf74-4ea2f1428020 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:24.217943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882fc9-b392-408a-bf74-4ea2f1428020 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:24.219643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882fc9-b392-408a-bf74-4ea2f1428020 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:24.247359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 938/1883] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:24.251180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:24.252845 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:24.283073 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f1d8-1ca6-4d7e-83cc-ff1b131df868 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:24.292716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b05d6-7445-44e3-8f9c-ec90da7b4f6a tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8196f21367d44ae494d5d10f4586e124', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '687f2d33eb2d4c73ad2a7e69ed2b9c39', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:24.293708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b05d6-7445-44e3-8f9c-ec90da7b4f6a tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:24.294171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b05d6-7445-44e3-8f9c-ec90da7b4f6a tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:24.294526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b05d6-7445-44e3-8f9c-ec90da7b4f6a tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:24.295741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b05d6-7445-44e3-8f9c-ec90da7b4f6a tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:24.300000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b05d6-7445-44e3-8f9c-ec90da7b4f6a tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:24.347367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 946/1884] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:24 2022] POST /identity/v3/projects => generated 353 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:24.353975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882fc9-b392-408a-bf74-4ea2f1428020 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:24.368074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882fc9-b392-408a-bf74-4ea2f1428020 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:24.482791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8196f21367d44ae494d5d10f4586e124', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '687f2d33eb2d4c73ad2a7e69ed2b9c39', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:24.484054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:24.484054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:24.484394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:24.485457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:24.486536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:24.488489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:24.503508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 939/1885] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:24.548193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b05d6-7445-44e3-8f9c-ec90da7b4f6a tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:24.560091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b05d6-7445-44e3-8f9c-ec90da7b4f6a tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:24.567024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8196f21367d44ae494d5d10f4586e124', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '687f2d33eb2d4c73ad2a7e69ed2b9c39', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:24.567970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:24.568250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:24.568558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] PATH_INFO: `/v3/projects/c43136c7e3464f28b133f9ac490c757f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:24.570001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c43136c7e3464f28b133f9ac490c757f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:24.573188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:24.632534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43136c7e3464f28b133f9ac490c757f', 'request_id': 'req-b685e5c4-6700-415e-a232-0154959076c5'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:24.640461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43136c7e3464f28b133f9ac490c757f', 'request_id': 'req-b685e5c4-6700-415e-a232-0154959076c5'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:24.655549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43136c7e3464f28b133f9ac490c757f', 'request_id': 'req-b685e5c4-6700-415e-a232-0154959076c5'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:24.673302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] The token cache is being invalidate because project c43136c7e3464f28b133f9ac490c757f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:24.673986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:24.675662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:24.682481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 947/1886] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:24 2022] DELETE /identity/v3/projects/c43136c7e3464f28b133f9ac490c757f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:24.783493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:24.786189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:24.891729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ee400-026e-4d78-8a9a-8d33ed9019c9 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:24.942140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:24.944044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:24.974117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:24.974988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:24.975266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:24.975541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] PATH_INFO: `/v3/projects/39353900043b46df8d289b91b89ef905` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:24.976844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=39353900043b46df8d289b91b89ef905)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:24.978785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.026729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685e5c4-6700-415e-a232-0154959076c5 tempest-VolumeQuotaClassesTest-660181247 tempest-VolumeQuotaClassesTest-660181247-project-admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:25.037938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39353900043b46df8d289b91b89ef905', 'request_id': 'req-6dece343-ddd1-438e-b198-6d7f12868beb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.045535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39353900043b46df8d289b91b89ef905', 'request_id': 'req-6dece343-ddd1-438e-b198-6d7f12868beb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.052253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39353900043b46df8d289b91b89ef905', 'request_id': 'req-6dece343-ddd1-438e-b198-6d7f12868beb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.065905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] The token cache is being invalidate because project 39353900043b46df8d289b91b89ef905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:25.066351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.067353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6dece343-ddd1-438e-b198-6d7f12868beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.069455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 940/1887] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:24 2022] DELETE /identity/v3/projects/39353900043b46df8d289b91b89ef905 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:25.077846 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27a017-0920-43c4-b63e-6d7fa51c175d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.078141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27a017-0920-43c4-b63e-6d7fa51c175d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.078422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27a017-0920-43c4-b63e-6d7fa51c175d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.093531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:25.094729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.095292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.095712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] PATH_INFO: `/v3/users/21129c36ae8e47d38b706d8ae2b48b8f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.097273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21129c36ae8e47d38b706d8ae2b48b8f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:25.098402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1b27a017-0920-43c4-b63e-6d7fa51c175d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:25.099629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1b27a017-0920-43c4-b63e-6d7fa51c175d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:25.101154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.112499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 941/1888] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:25.116508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac19f6-3ea8-498e-b8eb-9455e80f8a1b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.116856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac19f6-3ea8-498e-b8eb-9455e80f8a1b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.117241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac19f6-3ea8-498e-b8eb-9455e80f8a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.137716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f1ac19f6-3ea8-498e-b8eb-9455e80f8a1b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:25.139203 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f1ac19f6-3ea8-498e-b8eb-9455e80f8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:25.149072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 942/1889] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:25.152844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac19f6-3ea8-498e-b8eb-9455e80f8a1b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:25.158429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21129c36ae8e47d38b706d8ae2b48b8f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.163045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac19f6-3ea8-498e-b8eb-9455e80f8a1b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:25.169765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:25.170138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21129c36ae8e47d38b706d8ae2b48b8f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.170979 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.171462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.171944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.173087 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:25.173577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:25.175523 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.178707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21129c36ae8e47d38b706d8ae2b48b8f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.189497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 943/1890] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:41:25.192294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21129c36ae8e47d38b706d8ae2b48b8f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.193307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8bff7f8c-7ad5-463d-b202-515a5420ef5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21129c36ae8e47d38b706d8ae2b48b8f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:25.194068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:25.196440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:25.201743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 948/1891] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:24 2022] DELETE /identity/v3/users/21129c36ae8e47d38b706d8ae2b48b8f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:25.206462 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360b4d-6115-4f38-ab4e-b5b7694b0905 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.207478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360b4d-6115-4f38-ab4e-b5b7694b0905 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.207800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360b4d-6115-4f38-ab4e-b5b7694b0905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.216293 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10f63c-d807-478f-988e-f687eabb5e03 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:25.231295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-da360b4d-6115-4f38-ab4e-b5b7694b0905 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:25.232955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-da360b4d-6115-4f38-ab4e-b5b7694b0905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:25.305187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4156-47c5-4e02-ba9e-cb8fcfc8c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:25.306155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4156-47c5-4e02-ba9e-cb8fcfc8c76a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.306641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4156-47c5-4e02-ba9e-cb8fcfc8c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.310770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4156-47c5-4e02-ba9e-cb8fcfc8c76a admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.310911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 949/1892] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:25.311005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec4156-47c5-4e02-ba9e-cb8fcfc8c76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:25.311517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec4156-47c5-4e02-ba9e-cb8fcfc8c76a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.329707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360b4d-6115-4f38-ab4e-b5b7694b0905 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:25.332761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-da360b4d-6115-4f38-ab4e-b5b7694b0905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:25.377499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 944/1893] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:25 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:25.381730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4156-47c5-4e02-ba9e-cb8fcfc8c76a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:25.434881 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360b4d-6115-4f38-ab4e-b5b7694b0905 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:25.485147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4156-47c5-4e02-ba9e-cb8fcfc8c76a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:25.491954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eb03a-9cce-4937-b335-3de042ff7849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:25.492673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eb03a-9cce-4937-b335-3de042ff7849 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.492955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eb03a-9cce-4937-b335-3de042ff7849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.493259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eb03a-9cce-4937-b335-3de042ff7849 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.495283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eb03a-9cce-4937-b335-3de042ff7849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:25.497552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eb03a-9cce-4937-b335-3de042ff7849 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.509810 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef28a74-4142-4b1e-84d1-668bae2788b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:25.511141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef28a74-4142-4b1e-84d1-668bae2788b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.512393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef28a74-4142-4b1e-84d1-668bae2788b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.512744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef28a74-4142-4b1e-84d1-668bae2788b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.524797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 945/1894] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:25 2022] POST /identity/v3/users => generated 282 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:25.529738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eb03a-9cce-4937-b335-3de042ff7849 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:25.530586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef28a74-4142-4b1e-84d1-668bae2788b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:25.532056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef28a74-4142-4b1e-84d1-668bae2788b1 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.543910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eb03a-9cce-4937-b335-3de042ff7849 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:25.544384 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 950/1895] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:25.549521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cf308-8fd8-441f-8179-c48a1573f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:25.550185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cf308-8fd8-441f-8179-c48a1573f753 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.550464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cf308-8fd8-441f-8179-c48a1573f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.551434 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cf308-8fd8-441f-8179-c48a1573f753 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.552177 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cf308-8fd8-441f-8179-c48a1573f753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:25.553805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cf308-8fd8-441f-8179-c48a1573f753 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.567238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 946/1896] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:25.568668 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef28a74-4142-4b1e-84d1-668bae2788b1 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:25.579105 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef28a74-4142-4b1e-84d1-668bae2788b1 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:25.585006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdda49-4581-43f0-90ce-75213a6da69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:25.585670 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdda49-4581-43f0-90ce-75213a6da69d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.585957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdda49-4581-43f0-90ce-75213a6da69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.586228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdda49-4581-43f0-90ce-75213a6da69d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.587098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdda49-4581-43f0-90ce-75213a6da69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:25.588865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdda49-4581-43f0-90ce-75213a6da69d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.601085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 951/1897] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:25.605501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cf308-8fd8-441f-8179-c48a1573f753 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:25.619170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cf308-8fd8-441f-8179-c48a1573f753 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:25.629575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeaa6d-2ec8-4926-b3d9-c480103f9c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:25.629575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeaa6d-2ec8-4926-b3d9-c480103f9c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.629575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeaa6d-2ec8-4926-b3d9-c480103f9c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.629575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eeaa6d-2ec8-4926-b3d9-c480103f9c43 admin admin] PATH_INFO: `/v3/projects/8513aa0bc8d94e31bdcec27a458325e8/users/dd5f35c1a4474fbd9db8c69d437d21ec/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.645424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeaa6d-2ec8-4926-b3d9-c480103f9c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8513aa0bc8d94e31bdcec27a458325e8, user_id=dd5f35c1a4474fbd9db8c69d437d21ec, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:25.648803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eeaa6d-2ec8-4926-b3d9-c480103f9c43 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.674413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 947/1898] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:25 2022] PUT /identity/v3/projects/8513aa0bc8d94e31bdcec27a458325e8/users/dd5f35c1a4474fbd9db8c69d437d21ec/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:25.690704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687b2f7-6337-4853-9287-4404b5d8ed36 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.691534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687b2f7-6337-4853-9287-4404b5d8ed36 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.691534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687b2f7-6337-4853-9287-4404b5d8ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.715311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeaa6d-2ec8-4926-b3d9-c480103f9c43 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:25.717825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c2eeaa6d-2ec8-4926-b3d9-c480103f9c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:25.768458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9687b2f7-6337-4853-9287-4404b5d8ed36 None None] MFA Rules not processed for user `dd5f35c1a4474fbd9db8c69d437d21ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:25.770527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9687b2f7-6337-4853-9287-4404b5d8ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:25.866842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eeaa6d-2ec8-4926-b3d9-c480103f9c43 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:25.877946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:25.878994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:25.879282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:25.880403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] PATH_INFO: `/v3/users/bfd6087d4b4d4a35947a01769e1e63b8` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:25.882992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd6087d4b4d4a35947a01769e1e63b8)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:25.888806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:25.924397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 952/1899] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:25.930930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687b2f7-6337-4853-9287-4404b5d8ed36 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:25.980902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687b2f7-6337-4853-9287-4404b5d8ed36 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:26.000010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de992b-e8b8-4788-8126-1fde1e924bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:26.000743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de992b-e8b8-4788-8126-1fde1e924bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:26.002126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de992b-e8b8-4788-8126-1fde1e924bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:26.002126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de992b-e8b8-4788-8126-1fde1e924bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:26.005490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de992b-e8b8-4788-8126-1fde1e924bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:26.012693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de992b-e8b8-4788-8126-1fde1e924bc8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:26.027315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd6087d4b4d4a35947a01769e1e63b8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:26.063300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd6087d4b4d4a35947a01769e1e63b8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:26.108703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 953/1900] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:25 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:26.110536 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de992b-e8b8-4788-8126-1fde1e924bc8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:26.111964 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd6087d4b4d4a35947a01769e1e63b8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:26.118398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd6087d4b4d4a35947a01769e1e63b8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:26.139204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd6087d4b4d4a35947a01769e1e63b8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:26.157498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 948/1901] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:25 2022] DELETE /identity/v3/users/bfd6087d4b4d4a35947a01769e1e63b8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:26.221324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de992b-e8b8-4788-8126-1fde1e924bc8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:26.294192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d5f1a-86e5-47f2-920f-42408ac2a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:26.295151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d5f1a-86e5-47f2-920f-42408ac2a170 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:26.295511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d5f1a-86e5-47f2-920f-42408ac2a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:26.295861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d5f1a-86e5-47f2-920f-42408ac2a170 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:26.298268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d5f1a-86e5-47f2-920f-42408ac2a170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:26.300784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d5f1a-86e5-47f2-920f-42408ac2a170 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:26.349593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 954/1902] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:26 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:26.353784 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:26.355368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:26.372796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd1d88-6a8a-461e-a421-bd48812de40d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:26.394791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2961b2-c301-4dc9-ac04-ca7d6373be7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:26.395582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2961b2-c301-4dc9-ac04-ca7d6373be7d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:26.395874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2961b2-c301-4dc9-ac04-ca7d6373be7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:26.397347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2961b2-c301-4dc9-ac04-ca7d6373be7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:26.398231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2961b2-c301-4dc9-ac04-ca7d6373be7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:26.403316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2961b2-c301-4dc9-ac04-ca7d6373be7d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:26.428788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 949/1903] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:26.432468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d5f1a-86e5-47f2-920f-42408ac2a170 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:26.446276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d5f1a-86e5-47f2-920f-42408ac2a170 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:26.452734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae80b-7ec8-47e7-ad3c-8272beed8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:26.453915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae80b-7ec8-47e7-ad3c-8272beed8494 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:26.454196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae80b-7ec8-47e7-ad3c-8272beed8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:26.454478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ae80b-7ec8-47e7-ad3c-8272beed8494 admin admin] PATH_INFO: `/v3/projects/beb88c1a2b60405c93d2551ce5eb49ea/users/b06b734280cd4927a358c93164aef49a/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:26.491901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae80b-7ec8-47e7-ad3c-8272beed8494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb88c1a2b60405c93d2551ce5eb49ea, user_id=b06b734280cd4927a358c93164aef49a, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:26.499437 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ae80b-7ec8-47e7-ad3c-8272beed8494 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:26.527885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 955/1904] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:26 2022] PUT /identity/v3/projects/beb88c1a2b60405c93d2551ce5eb49ea/users/b06b734280cd4927a358c93164aef49a/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:26.531749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2961b2-c301-4dc9-ac04-ca7d6373be7d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:26.551871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2961b2-c301-4dc9-ac04-ca7d6373be7d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:26.599638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae80b-7ec8-47e7-ad3c-8272beed8494 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:26.605214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d88ae80b-7ec8-47e7-ad3c-8272beed8494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:26.643992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029bf9c-0712-42e7-8dae-811ef763258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:26.645186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029bf9c-0712-42e7-8dae-811ef763258c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:26.645480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029bf9c-0712-42e7-8dae-811ef763258c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:26.645763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029bf9c-0712-42e7-8dae-811ef763258c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:26.646735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029bf9c-0712-42e7-8dae-811ef763258c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:26.648470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029bf9c-0712-42e7-8dae-811ef763258c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:26.676196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 950/1905] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:26.680974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029bf9c-0712-42e7-8dae-811ef763258c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:26.714067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029bf9c-0712-42e7-8dae-811ef763258c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:26.744741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75315451-95ef-4443-9970-31340c2f0730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:26.747336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75315451-95ef-4443-9970-31340c2f0730 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:26.747626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75315451-95ef-4443-9970-31340c2f0730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:26.749741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75315451-95ef-4443-9970-31340c2f0730 admin admin] PATH_INFO: `/v3/projects/beb88c1a2b60405c93d2551ce5eb49ea/users/b06b734280cd4927a358c93164aef49a/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:26.754604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75315451-95ef-4443-9970-31340c2f0730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb88c1a2b60405c93d2551ce5eb49ea, user_id=b06b734280cd4927a358c93164aef49a, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:26.757468 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75315451-95ef-4443-9970-31340c2f0730 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:26.788229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ae80b-7ec8-47e7-ad3c-8272beed8494 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:26.796485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 951/1906] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:26 2022] PUT /identity/v3/projects/beb88c1a2b60405c93d2551ce5eb49ea/users/b06b734280cd4927a358c93164aef49a/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:26.801743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384065-35ee-4d55-a2a5-98125177ddda None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:26.802032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384065-35ee-4d55-a2a5-98125177ddda None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:26.802449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45384065-35ee-4d55-a2a5-98125177ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:26.848898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-45384065-35ee-4d55-a2a5-98125177ddda None None] MFA Rules not processed for user `b06b734280cd4927a358c93164aef49a`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:26.850406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-45384065-35ee-4d55-a2a5-98125177ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:26.903793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:26.904945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:26.905392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:26.906044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] PATH_INFO: `/v3/projects/dfb60f83f96341c69ee5edea1b349598` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:26.907714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb60f83f96341c69ee5edea1b349598)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:26.911494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:27.023181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb60f83f96341c69ee5edea1b349598', 'request_id': 'req-cfdb2aee-29c2-4dd6-aea0-328b5765902a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.047394 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb60f83f96341c69ee5edea1b349598', 'request_id': 'req-cfdb2aee-29c2-4dd6-aea0-328b5765902a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.060396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 952/1907] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:26 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:27.074914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384065-35ee-4d55-a2a5-98125177ddda None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:27.075160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb60f83f96341c69ee5edea1b349598', 'request_id': 'req-cfdb2aee-29c2-4dd6-aea0-328b5765902a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.076758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-45384065-35ee-4d55-a2a5-98125177ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:27.093407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] The token cache is being invalidate because project dfb60f83f96341c69ee5edea1b349598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:27.094299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.096417 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.099585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 956/1908] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:26 2022] DELETE /identity/v3/projects/dfb60f83f96341c69ee5edea1b349598 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:27.103743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:27.105775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:27.241384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45384065-35ee-4d55-a2a5-98125177ddda None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:27.257492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb2aee-29c2-4dd6-aea0-328b5765902a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:27.263679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:27.265173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:27.265532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:27.265883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] PATH_INFO: `/v3/users/8196f21367d44ae494d5d10f4586e124` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:27.267776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8196f21367d44ae494d5d10f4586e124)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:27.271080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:27.337541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:27.338370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:27.338752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:27.339134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:27.341765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:27.341911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8196f21367d44ae494d5d10f4586e124'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.352626 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8196f21367d44ae494d5d10f4586e124'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.362313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8196f21367d44ae494d5d10f4586e124'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.379426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8196f21367d44ae494d5d10f4586e124'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.380301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8196f21367d44ae494d5d10f4586e124'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.388415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 957/1909] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:27 2022] DELETE /identity/v3/users/8196f21367d44ae494d5d10f4586e124 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:27.388415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:27.390884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:27.429590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:27.433311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:27.459856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 953/1910] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:27.510286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7d763-7262-4cfc-ae22-42f749b83bdd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:27.515106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:27.515969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:27.516252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:27.517103 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] PATH_INFO: `/v3/projects/bd996ef1c51d473dbf5ff7e5fe2b7dd6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:27.518491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd996ef1c51d473dbf5ff7e5fe2b7dd6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:27.521174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:27.558980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:27.561891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:27.585383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddf98-515f-4d7b-8dc8-b32028a95f1e service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:27.619253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd996ef1c51d473dbf5ff7e5fe2b7dd6', 'request_id': 'req-5eb020a1-55d9-47ef-bb69-032b36927632'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.633684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd996ef1c51d473dbf5ff7e5fe2b7dd6', 'request_id': 'req-5eb020a1-55d9-47ef-bb69-032b36927632'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.649191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd996ef1c51d473dbf5ff7e5fe2b7dd6', 'request_id': 'req-5eb020a1-55d9-47ef-bb69-032b36927632'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.673053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] The token cache is being invalidate because project bd996ef1c51d473dbf5ff7e5fe2b7dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:27.673647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.674780 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.679650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 958/1911] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:27 2022] DELETE /identity/v3/projects/bd996ef1c51d473dbf5ff7e5fe2b7dd6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:27.681208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:27.681507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:27.681785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:27.682681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:27.683065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:27.684603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:27.685563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:27.774183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb020a1-55d9-47ef-bb69-032b36927632 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:27.779501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:27.779699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:27.780397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:27.780674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:27.780954 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] PATH_INFO: `/v3/users/4db3af371b82495d9ff04c55ef39dfe4` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:27.781911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:27.782197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db3af371b82495d9ff04c55ef39dfe4)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:27.784148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:27.797086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 954/1912] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:27.808851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:27.810376 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:27.827349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7bb4-3530-40e7-ab98-2d0d7bd55120 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:27.833993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:27.835100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:27.835462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:27.836672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] PATH_INFO: `/v3/projects/687f2d33eb2d4c73ad2a7e69ed2b9c39` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:27.838110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687f2d33eb2d4c73ad2a7e69ed2b9c39)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:27.841216 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:27.856377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db3af371b82495d9ff04c55ef39dfe4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.866074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db3af371b82495d9ff04c55ef39dfe4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.876930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db3af371b82495d9ff04c55ef39dfe4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.892636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db3af371b82495d9ff04c55ef39dfe4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.893514 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1c00048f-c726-4d35-800a-2d2e9aada6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db3af371b82495d9ff04c55ef39dfe4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.903758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 959/1913] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:27 2022] DELETE /identity/v3/users/4db3af371b82495d9ff04c55ef39dfe4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:27.918392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687f2d33eb2d4c73ad2a7e69ed2b9c39', 'request_id': 'req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.932335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687f2d33eb2d4c73ad2a7e69ed2b9c39', 'request_id': 'req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.940139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687f2d33eb2d4c73ad2a7e69ed2b9c39', 'request_id': 'req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.965232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] The token cache is being invalidate because project 687f2d33eb2d4c73ad2a7e69ed2b9c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:27.967449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.967449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a7ef73bd-9692-402f-9ed1-635f4ee7ed92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:27.969350 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 955/1914] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:27 2022] DELETE /identity/v3/projects/687f2d33eb2d4c73ad2a7e69ed2b9c39 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:27.975215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152dd84-a39c-439c-9cdb-64224462d1ec None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:27.975509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152dd84-a39c-439c-9cdb-64224462d1ec None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:27.975788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152dd84-a39c-439c-9cdb-64224462d1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.009753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8152dd84-a39c-439c-9cdb-64224462d1ec None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:28.011142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8152dd84-a39c-439c-9cdb-64224462d1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.097975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 960/1915] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:28.106801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b54f5b-3e3e-4bcc-ba10-32f86455f2ad None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.107033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b54f5b-3e3e-4bcc-ba10-32f86455f2ad None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.107482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b54f5b-3e3e-4bcc-ba10-32f86455f2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.131930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-41b54f5b-3e3e-4bcc-ba10-32f86455f2ad None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:28.133244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-41b54f5b-3e3e-4bcc-ba10-32f86455f2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.147159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 956/1916] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:28.152852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152dd84-a39c-439c-9cdb-64224462d1ec None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.170135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b54f5b-3e3e-4bcc-ba10-32f86455f2ad None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.171139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152dd84-a39c-439c-9cdb-64224462d1ec None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.184275 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-41b54f5b-3e3e-4bcc-ba10-32f86455f2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.189670 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4c87c-0219-4fc3-b60f-108643fec6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.190637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4c87c-0219-4fc3-b60f-108643fec6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.191194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4c87c-0219-4fc3-b60f-108643fec6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.192470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4c87c-0219-4fc3-b60f-108643fec6d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.193944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4c87c-0219-4fc3-b60f-108643fec6d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:28.194405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b54f5b-3e3e-4bcc-ba10-32f86455f2ad None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.194880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4c87c-0219-4fc3-b60f-108643fec6d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.196724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4c87c-0219-4fc3-b60f-108643fec6d0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.200533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.201589 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.201949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.202267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] PATH_INFO: `/v3/projects/d41c45e12fe74d90b89a6c56b1345ca4` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.203450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41c45e12fe74d90b89a6c56b1345ca4)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.205370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.231861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 961/1917] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:28.236699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4c87c-0219-4fc3-b60f-108643fec6d0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.248152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4c87c-0219-4fc3-b60f-108643fec6d0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.252849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846edd5-0206-4c04-a323-c00fbc35b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.253499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846edd5-0206-4c04-a323-c00fbc35b11a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.253809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846edd5-0206-4c04-a323-c00fbc35b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.254082 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846edd5-0206-4c04-a323-c00fbc35b11a admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.254782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846edd5-0206-4c04-a323-c00fbc35b11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.256712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846edd5-0206-4c04-a323-c00fbc35b11a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.280803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41c45e12fe74d90b89a6c56b1345ca4', 'request_id': 'req-54eade67-2ceb-47d2-89c6-0e2a413fbe63'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.282153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 962/1918] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:28.286965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846edd5-0206-4c04-a323-c00fbc35b11a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.287672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41c45e12fe74d90b89a6c56b1345ca4', 'request_id': 'req-54eade67-2ceb-47d2-89c6-0e2a413fbe63'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.293561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41c45e12fe74d90b89a6c56b1345ca4', 'request_id': 'req-54eade67-2ceb-47d2-89c6-0e2a413fbe63'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.306629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] The token cache is being invalidate because project d41c45e12fe74d90b89a6c56b1345ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:28.306921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.307557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54eade67-2ceb-47d2-89c6-0e2a413fbe63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.309193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 957/1919] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:28 2022] DELETE /identity/v3/projects/d41c45e12fe74d90b89a6c56b1345ca4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:28.316361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5e3b2-c8d7-4945-ad86-9209cad6aebe None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.316660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5e3b2-c8d7-4945-ad86-9209cad6aebe None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.316935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5e3b2-c8d7-4945-ad86-9209cad6aebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.339244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5da5e3b2-c8d7-4945-ad86-9209cad6aebe None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:28.340502 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5da5e3b2-c8d7-4945-ad86-9209cad6aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.349130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 958/1920] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:28.350909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846edd5-0206-4c04-a323-c00fbc35b11a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.355613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1d158-24e1-4cf5-ace3-b3514c25ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.356287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d158-24e1-4cf5-ace3-b3514c25ae40 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.356664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d158-24e1-4cf5-ace3-b3514c25ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.356782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfff132-dc5e-4e22-ada1-3b2b745b2fac None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.357050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d158-24e1-4cf5-ace3-b3514c25ae40 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.357159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfff132-dc5e-4e22-ada1-3b2b745b2fac None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.357382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfff132-dc5e-4e22-ada1-3b2b745b2fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.357719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1d158-24e1-4cf5-ace3-b3514c25ae40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.359681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1d158-24e1-4cf5-ace3-b3514c25ae40 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.376146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bcfff132-dc5e-4e22-ada1-3b2b745b2fac None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:28.377381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bcfff132-dc5e-4e22-ada1-3b2b745b2fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.379557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 963/1921] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/users => generated 280 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:28.383448 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1d158-24e1-4cf5-ace3-b3514c25ae40 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.385004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-94a1d158-24e1-4cf5-ace3-b3514c25ae40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.388644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 959/1922] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:28.389752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfff132-dc5e-4e22-ada1-3b2b745b2fac None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.397109 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1d158-24e1-4cf5-ace3-b3514c25ae40 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.399918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfff132-dc5e-4e22-ada1-3b2b745b2fac None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.401866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78fb50-1628-438b-be4b-ea46b22d89f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.402541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78fb50-1628-438b-be4b-ea46b22d89f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.402822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78fb50-1628-438b-be4b-ea46b22d89f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.403091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78fb50-1628-438b-be4b-ea46b22d89f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.403826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78fb50-1628-438b-be4b-ea46b22d89f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.405046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15e89-c921-4846-aa75-e16885b65c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.405463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78fb50-1628-438b-be4b-ea46b22d89f1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.405705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15e89-c921-4846-aa75-e16885b65c45 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.405989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15e89-c921-4846-aa75-e16885b65c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.406294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e15e89-c921-4846-aa75-e16885b65c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.407029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e15e89-c921-4846-aa75-e16885b65c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:28.407333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e15e89-c921-4846-aa75-e16885b65c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.408970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e15e89-c921-4846-aa75-e16885b65c45 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.416138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 964/1923] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:28.419893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78fb50-1628-438b-be4b-ea46b22d89f1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.421327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 960/1924] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:28.425438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15e89-c921-4846-aa75-e16885b65c45 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.430065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78fb50-1628-438b-be4b-ea46b22d89f1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.434766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac94e0-ef21-4173-a410-02aa5b397e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.435410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac94e0-ef21-4173-a410-02aa5b397e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.435684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac94e0-ef21-4173-a410-02aa5b397e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.435882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e15e89-c921-4846-aa75-e16885b65c45 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.436374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac94e0-ef21-4173-a410-02aa5b397e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.436703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac94e0-ef21-4173-a410-02aa5b397e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.438285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac94e0-ef21-4173-a410-02aa5b397e17 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.440572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3a079-e989-4d6b-a96d-f9ccaec8a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.441252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3a079-e989-4d6b-a96d-f9ccaec8a62b admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.441538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3a079-e989-4d6b-a96d-f9ccaec8a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.441825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3a079-e989-4d6b-a96d-f9ccaec8a62b admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.442516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3a079-e989-4d6b-a96d-f9ccaec8a62b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.444399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3a079-e989-4d6b-a96d-f9ccaec8a62b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.451669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 965/1925] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:28.452712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac94e0-ef21-4173-a410-02aa5b397e17 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.464226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac94e0-ef21-4173-a410-02aa5b397e17 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.469859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41bff1-907b-4f81-a9d3-8fcb75310d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.470947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41bff1-907b-4f81-a9d3-8fcb75310d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.471242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41bff1-907b-4f81-a9d3-8fcb75310d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.471497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41bff1-907b-4f81-a9d3-8fcb75310d0e admin admin] PATH_INFO: `/v3/projects/42b0f17c7d9344fea0cec42d1ad9f8a9/users/f11aae943dbc4464b9d2ff18424c9850/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.480535 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 961/1926] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:28.481477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3a079-e989-4d6b-a96d-f9ccaec8a62b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.487535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41bff1-907b-4f81-a9d3-8fcb75310d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b0f17c7d9344fea0cec42d1ad9f8a9, user_id=f11aae943dbc4464b9d2ff18424c9850, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.490759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41bff1-907b-4f81-a9d3-8fcb75310d0e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.503860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 966/1927] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:28 2022] PUT /identity/v3/projects/42b0f17c7d9344fea0cec42d1ad9f8a9/users/f11aae943dbc4464b9d2ff18424c9850/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:28.515036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73539a-87e1-4e6d-baf0-064bb488770f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.515320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73539a-87e1-4e6d-baf0-064bb488770f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.515593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73539a-87e1-4e6d-baf0-064bb488770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.543492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3a079-e989-4d6b-a96d-f9ccaec8a62b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.545957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ca73539a-87e1-4e6d-baf0-064bb488770f None None] MFA Rules not processed for user `f11aae943dbc4464b9d2ff18424c9850`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:28.547228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ca73539a-87e1-4e6d-baf0-064bb488770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.605366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e11ee-a33b-4701-b520-0f0ba7395d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.606033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e11ee-a33b-4701-b520-0f0ba7395d35 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.606314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e11ee-a33b-4701-b520-0f0ba7395d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.606589 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e11ee-a33b-4701-b520-0f0ba7395d35 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.607379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e11ee-a33b-4701-b520-0f0ba7395d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.609292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e11ee-a33b-4701-b520-0f0ba7395d35 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.612193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 967/1928] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:28.635989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 962/1929] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:28.637450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73539a-87e1-4e6d-baf0-064bb488770f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.648995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73539a-87e1-4e6d-baf0-064bb488770f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.654362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e11ee-a33b-4701-b520-0f0ba7395d35 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.655213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d567eeb-c319-4bdb-a9f6-7b6794d80bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.655869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567eeb-c319-4bdb-a9f6-7b6794d80bfb admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.656148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567eeb-c319-4bdb-a9f6-7b6794d80bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.656453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d567eeb-c319-4bdb-a9f6-7b6794d80bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.657192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d567eeb-c319-4bdb-a9f6-7b6794d80bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.657431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2f2e11ee-a33b-4701-b520-0f0ba7395d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.658821 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d567eeb-c319-4bdb-a9f6-7b6794d80bfb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.670470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 968/1930] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:28.674746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d567eeb-c319-4bdb-a9f6-7b6794d80bfb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.687480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d567eeb-c319-4bdb-a9f6-7b6794d80bfb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.692468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cebc2a-b8b6-4068-9f55-e5bb53c8517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.693167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cebc2a-b8b6-4068-9f55-e5bb53c8517a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.693460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cebc2a-b8b6-4068-9f55-e5bb53c8517a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.693769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cebc2a-b8b6-4068-9f55-e5bb53c8517a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.695058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cebc2a-b8b6-4068-9f55-e5bb53c8517a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.696304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cebc2a-b8b6-4068-9f55-e5bb53c8517a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.707827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 969/1931] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:28.712174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cebc2a-b8b6-4068-9f55-e5bb53c8517a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.729533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cebc2a-b8b6-4068-9f55-e5bb53c8517a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.731733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e11ee-a33b-4701-b520-0f0ba7395d35 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.735297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d60fe-c22c-4bc5-b2ce-0cf9ec6a4e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.735975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e93d5-4fa1-463d-89ff-02c1e9d5c928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.736489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d60fe-c22c-4bc5-b2ce-0cf9ec6a4e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.736774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d60fe-c22c-4bc5-b2ce-0cf9ec6a4e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.736883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e93d5-4fa1-463d-89ff-02c1e9d5c928 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.737053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d60fe-c22c-4bc5-b2ce-0cf9ec6a4e9a admin admin] PATH_INFO: `/v3/projects/0336eb36243d4523a9eb9fe0b8cc6f39/users/6bdc47212731405fbbe0422046440b4c/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.737190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e93d5-4fa1-463d-89ff-02c1e9d5c928 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.737583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e93d5-4fa1-463d-89ff-02c1e9d5c928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.748457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e93d5-4fa1-463d-89ff-02c1e9d5c928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.750217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e93d5-4fa1-463d-89ff-02c1e9d5c928 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.754190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d60fe-c22c-4bc5-b2ce-0cf9ec6a4e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0336eb36243d4523a9eb9fe0b8cc6f39, user_id=6bdc47212731405fbbe0422046440b4c, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.756983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d60fe-c22c-4bc5-b2ce-0cf9ec6a4e9a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.761095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 963/1932] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:28 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:28.783224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 970/1933] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:28 2022] PUT /identity/v3/projects/0336eb36243d4523a9eb9fe0b8cc6f39/users/6bdc47212731405fbbe0422046440b4c/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:28.783435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e93d5-4fa1-463d-89ff-02c1e9d5c928 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.785870 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbb6e8-d223-40f7-8a18-b68f92866670 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.786170 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbb6e8-d223-40f7-8a18-b68f92866670 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.786447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbb6e8-d223-40f7-8a18-b68f92866670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.790791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e93d5-4fa1-463d-89ff-02c1e9d5c928 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.818930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-84dbb6e8-d223-40f7-8a18-b68f92866670 None None] MFA Rules not processed for user `6bdc47212731405fbbe0422046440b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:28.820172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-84dbb6e8-d223-40f7-8a18-b68f92866670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.858286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.859077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.859354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.859626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] PATH_INFO: `/v3/users/f11aae943dbc4464b9d2ff18424c9850` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.860896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11aae943dbc4464b9d2ff18424c9850)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.863896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.902639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 971/1934] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:28.907573 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbb6e8-d223-40f7-8a18-b68f92866670 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.918578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbb6e8-d223-40f7-8a18-b68f92866670 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:28.920142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11aae943dbc4464b9d2ff18424c9850'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.925043 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd27a7-e096-44a1-922b-7ac12803d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:28.925904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd27a7-e096-44a1-922b-7ac12803d5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.926314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd27a7-e096-44a1-922b-7ac12803d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.926656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd27a7-e096-44a1-922b-7ac12803d5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.927468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd27a7-e096-44a1-922b-7ac12803d5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:28.929167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11aae943dbc4464b9d2ff18424c9850'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.929437 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd27a7-e096-44a1-922b-7ac12803d5a4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:28.941369 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11aae943dbc4464b9d2ff18424c9850'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.942159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11aae943dbc4464b9d2ff18424c9850'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.949134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebff771-1619-4c8b-b43c-749bddcd3379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11aae943dbc4464b9d2ff18424c9850'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:28.954748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 972/1935] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:28.957623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 964/1936] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:28 2022] DELETE /identity/v3/users/f11aae943dbc4464b9d2ff18424c9850 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:28.961481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd27a7-e096-44a1-922b-7ac12803d5a4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:28.963323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad43ea-b333-41fc-9dc2-afb928901ac1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:28.963451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-87fd27a7-e096-44a1-922b-7ac12803d5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:28.963627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad43ea-b333-41fc-9dc2-afb928901ac1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:28.963880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad43ea-b333-41fc-9dc2-afb928901ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:28.983238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3fad43ea-b333-41fc-9dc2-afb928901ac1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:28.984491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3fad43ea-b333-41fc-9dc2-afb928901ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:29.029756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd27a7-e096-44a1-922b-7ac12803d5a4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:29.060516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 965/1937] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:29.068176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad43ea-b333-41fc-9dc2-afb928901ac1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:29.070559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3fad43ea-b333-41fc-9dc2-afb928901ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:29.105345 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ad3cb-002d-4ddc-b97c-6277bf753ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:29.106219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ad3cb-002d-4ddc-b97c-6277bf753ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.106578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ad3cb-002d-4ddc-b97c-6277bf753ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.106967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ad3cb-002d-4ddc-b97c-6277bf753ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.107614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ad3cb-002d-4ddc-b97c-6277bf753ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:29.109728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ad3cb-002d-4ddc-b97c-6277bf753ad6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:29.135322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 973/1938] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:28 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:29.136110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ad3cb-002d-4ddc-b97c-6277bf753ad6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:29.141267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad43ea-b333-41fc-9dc2-afb928901ac1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:29.145879 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233807fd-8b29-4648-a272-cb9b047b1664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:29.146642 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233807fd-8b29-4648-a272-cb9b047b1664 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.147170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233807fd-8b29-4648-a272-cb9b047b1664 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.147280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ad3cb-002d-4ddc-b97c-6277bf753ad6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:29.147710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233807fd-8b29-4648-a272-cb9b047b1664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.156564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0edc05-63b3-403a-9674-374b77cfe88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:29.157236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0edc05-63b3-403a-9674-374b77cfe88e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.157517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0edc05-63b3-403a-9674-374b77cfe88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.157785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0edc05-63b3-403a-9674-374b77cfe88e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.158517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0edc05-63b3-403a-9674-374b77cfe88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:29.160504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0edc05-63b3-403a-9674-374b77cfe88e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:29.165309 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233807fd-8b29-4648-a272-cb9b047b1664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:29.166944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233807fd-8b29-4648-a272-cb9b047b1664 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:29.170606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 974/1939] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:29.174652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0edc05-63b3-403a-9674-374b77cfe88e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:29.178373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 966/1940] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:29.189496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0edc05-63b3-403a-9674-374b77cfe88e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:29.195938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd7326-67b0-4011-ab61-e722f03e8c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:29.197208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7326-67b0-4011-ab61-e722f03e8c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.198266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7326-67b0-4011-ab61-e722f03e8c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.198644 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7326-67b0-4011-ab61-e722f03e8c55 admin admin] PATH_INFO: `/v3/projects/72cb7e32c4cf436398066384703dff17/users/c4e3d0caa3234e95a0b40174eb81516d/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.217568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd7326-67b0-4011-ab61-e722f03e8c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cb7e32c4cf436398066384703dff17, user_id=c4e3d0caa3234e95a0b40174eb81516d, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:29.220915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd7326-67b0-4011-ab61-e722f03e8c55 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:29.247764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 975/1941] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:29 2022] PUT /identity/v3/projects/72cb7e32c4cf436398066384703dff17/users/c4e3d0caa3234e95a0b40174eb81516d/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:29.248520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233807fd-8b29-4648-a272-cb9b047b1664 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:29.260321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233807fd-8b29-4648-a272-cb9b047b1664 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:29.373122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f631d0-d07c-4c0e-a478-c1671fe9673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:29.373895 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f631d0-d07c-4c0e-a478-c1671fe9673d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.376250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f631d0-d07c-4c0e-a478-c1671fe9673d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.376640 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f631d0-d07c-4c0e-a478-c1671fe9673d admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.377903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f631d0-d07c-4c0e-a478-c1671fe9673d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:29.380848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f631d0-d07c-4c0e-a478-c1671fe9673d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:29.399975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 967/1942] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:29.403601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd7326-67b0-4011-ab61-e722f03e8c55 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:29.414375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd7326-67b0-4011-ab61-e722f03e8c55 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:29.422992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c17bbe-d28b-404a-b71c-39792781105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:29.423893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c17bbe-d28b-404a-b71c-39792781105f admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.424168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c17bbe-d28b-404a-b71c-39792781105f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.424483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c17bbe-d28b-404a-b71c-39792781105f admin admin] PATH_INFO: `/v3/projects/72cb7e32c4cf436398066384703dff17/users/c4e3d0caa3234e95a0b40174eb81516d/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.427558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c17bbe-d28b-404a-b71c-39792781105f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cb7e32c4cf436398066384703dff17, user_id=c4e3d0caa3234e95a0b40174eb81516d, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:29.431202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c17bbe-d28b-404a-b71c-39792781105f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:29.449148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 976/1943] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:29 2022] PUT /identity/v3/projects/72cb7e32c4cf436398066384703dff17/users/c4e3d0caa3234e95a0b40174eb81516d/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:29.466599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8e2b6-f463-4820-86c2-4a01d108e250 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.467089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8e2b6-f463-4820-86c2-4a01d108e250 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.467181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8e2b6-f463-4820-86c2-4a01d108e250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.518558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2bf8e2b6-f463-4820-86c2-4a01d108e250 None None] MFA Rules not processed for user `c4e3d0caa3234e95a0b40174eb81516d`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:29.520905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2bf8e2b6-f463-4820-86c2-4a01d108e250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:29.619997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 968/1944] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:29.635054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c17bbe-d28b-404a-b71c-39792781105f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:29.637598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-31c17bbe-d28b-404a-b71c-39792781105f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:29.655687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8e2b6-f463-4820-86c2-4a01d108e250 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:29.657196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2bf8e2b6-f463-4820-86c2-4a01d108e250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:29.730590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c17bbe-d28b-404a-b71c-39792781105f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:29.735337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3691c-4c3d-4794-889f-1141c87ea512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:29.736178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3691c-4c3d-4794-889f-1141c87ea512 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.736668 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3691c-4c3d-4794-889f-1141c87ea512 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.737020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3691c-4c3d-4794-889f-1141c87ea512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.739776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1af3691c-4c3d-4794-889f-1141c87ea512 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:29.745619 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8e2b6-f463-4820-86c2-4a01d108e250 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:29.750948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:29.751806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.752767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.752767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] PATH_INFO: `/v3/projects/42b0f17c7d9344fea0cec42d1ad9f8a9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.753774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b0f17c7d9344fea0cec42d1ad9f8a9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:29.755693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:29.815198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3691c-4c3d-4794-889f-1141c87ea512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:29.817398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b0f17c7d9344fea0cec42d1ad9f8a9', 'request_id': 'req-c7e05cf1-a342-440b-85ac-b5643f8bd136'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:29.818070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3691c-4c3d-4794-889f-1141c87ea512 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:29.824164 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b0f17c7d9344fea0cec42d1ad9f8a9', 'request_id': 'req-c7e05cf1-a342-440b-85ac-b5643f8bd136'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:29.830170 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 977/1945] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:29.830423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b0f17c7d9344fea0cec42d1ad9f8a9', 'request_id': 'req-c7e05cf1-a342-440b-85ac-b5643f8bd136'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:29.850660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] The token cache is being invalidate because project 42b0f17c7d9344fea0cec42d1ad9f8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:29.850955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:29.851715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c7e05cf1-a342-440b-85ac-b5643f8bd136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:29.853275 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 969/1946] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:29 2022] DELETE /identity/v3/projects/42b0f17c7d9344fea0cec42d1ad9f8a9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:29.861054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809d3e-6a2a-4d67-8ef9-b67dc58b4066 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.861432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809d3e-6a2a-4d67-8ef9-b67dc58b4066 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.861838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f809d3e-6a2a-4d67-8ef9-b67dc58b4066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.883110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-4f809d3e-6a2a-4d67-8ef9-b67dc58b4066 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:29.884317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4f809d3e-6a2a-4d67-8ef9-b67dc58b4066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:29.961461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 978/1947] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:29.969579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9b0d-e004-4dce-a906-e376466d2083 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:29.969865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9b0d-e004-4dce-a906-e376466d2083 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:29.970205 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9b0d-e004-4dce-a906-e376466d2083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:29.996214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-00df9b0d-e004-4dce-a906-e376466d2083 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:29.997464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-00df9b0d-e004-4dce-a906-e376466d2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:30.005780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 970/1948] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:30.010814 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f809d3e-6a2a-4d67-8ef9-b67dc58b4066 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:30.023058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f809d3e-6a2a-4d67-8ef9-b67dc58b4066 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:30.034547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518eb64-b959-4daf-b41a-0458b4db645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:30.035984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518eb64-b959-4daf-b41a-0458b4db645d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.036266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518eb64-b959-4daf-b41a-0458b4db645d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.036572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518eb64-b959-4daf-b41a-0458b4db645d admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.037312 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518eb64-b959-4daf-b41a-0458b4db645d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:30.037622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518eb64-b959-4daf-b41a-0458b4db645d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:30.039242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518eb64-b959-4daf-b41a-0458b4db645d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:30.067172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 979/1949] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:30.068422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df9b0d-e004-4dce-a906-e376466d2083 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:30.078195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df9b0d-e004-4dce-a906-e376466d2083 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:30.083961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64538377-1e55-4933-bae2-d710fb8928b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:30.084900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64538377-1e55-4933-bae2-d710fb8928b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.085288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64538377-1e55-4933-bae2-d710fb8928b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.085613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64538377-1e55-4933-bae2-d710fb8928b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.086338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64538377-1e55-4933-bae2-d710fb8928b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:30.089720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64538377-1e55-4933-bae2-d710fb8928b0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:30.132132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 971/1950] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:30 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:30.135428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518eb64-b959-4daf-b41a-0458b4db645d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:30.149128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518eb64-b959-4daf-b41a-0458b4db645d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:30.230736 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e385f-00a2-4677-8c5f-d1a9d9c88224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:30.231727 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e385f-00a2-4677-8c5f-d1a9d9c88224 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.232121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e385f-00a2-4677-8c5f-d1a9d9c88224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.232510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e385f-00a2-4677-8c5f-d1a9d9c88224 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.233795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e385f-00a2-4677-8c5f-d1a9d9c88224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:30.236980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e385f-00a2-4677-8c5f-d1a9d9c88224 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:30.260183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 980/1951] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:30 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:30.265809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64538377-1e55-4933-bae2-d710fb8928b0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:30.276922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64538377-1e55-4933-bae2-d710fb8928b0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:30.281956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0048e-26b2-45bc-aaac-646f7b3e5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:30.282613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0048e-26b2-45bc-aaac-646f7b3e5333 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.282890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0048e-26b2-45bc-aaac-646f7b3e5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.283159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0048e-26b2-45bc-aaac-646f7b3e5333 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.284050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0048e-26b2-45bc-aaac-646f7b3e5333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:30.286278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0048e-26b2-45bc-aaac-646f7b3e5333 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:30.297260 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 972/1952] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:30.301231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e385f-00a2-4677-8c5f-d1a9d9c88224 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:30.311838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e385f-00a2-4677-8c5f-d1a9d9c88224 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:30.319539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef18f9b-dc3e-4e65-90c4-3b0a6596106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:30.320225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef18f9b-dc3e-4e65-90c4-3b0a6596106e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.320735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef18f9b-dc3e-4e65-90c4-3b0a6596106e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.320862 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef18f9b-dc3e-4e65-90c4-3b0a6596106e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.321617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef18f9b-dc3e-4e65-90c4-3b0a6596106e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:30.323519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef18f9b-dc3e-4e65-90c4-3b0a6596106e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:30.338418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 981/1953] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:30.339290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0048e-26b2-45bc-aaac-646f7b3e5333 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:30.350169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0048e-26b2-45bc-aaac-646f7b3e5333 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:30.354840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251df263-7efd-4a0c-bf5b-9cdbbbc52c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:30.355743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251df263-7efd-4a0c-bf5b-9cdbbbc52c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.356020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251df263-7efd-4a0c-bf5b-9cdbbbc52c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.356296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251df263-7efd-4a0c-bf5b-9cdbbbc52c5b admin admin] PATH_INFO: `/v3/projects/5b55ce70ae4b48179e1c49ff2685eb88/users/927e07ce3bc04561af5348f172bc770e/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.370735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251df263-7efd-4a0c-bf5b-9cdbbbc52c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b55ce70ae4b48179e1c49ff2685eb88, user_id=927e07ce3bc04561af5348f172bc770e, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:30.373438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251df263-7efd-4a0c-bf5b-9cdbbbc52c5b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:30.385493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 973/1954] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:30 2022] PUT /identity/v3/projects/5b55ce70ae4b48179e1c49ff2685eb88/users/927e07ce3bc04561af5348f172bc770e/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:30.395920 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d0736-7faa-4241-b29c-fedddf34ab9b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.396138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d0736-7faa-4241-b29c-fedddf34ab9b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.396450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d0736-7faa-4241-b29c-fedddf34ab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.423642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-311d0736-7faa-4241-b29c-fedddf34ab9b None None] MFA Rules not processed for user `927e07ce3bc04561af5348f172bc770e`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:30.424920 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-311d0736-7faa-4241-b29c-fedddf34ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:30.496235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 982/1955] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:30.506771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251df263-7efd-4a0c-bf5b-9cdbbbc52c5b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:30.508606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-251df263-7efd-4a0c-bf5b-9cdbbbc52c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:30.569432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251df263-7efd-4a0c-bf5b-9cdbbbc52c5b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:30.573975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cf66b-550b-495d-b5e8-01d8ba3e8f90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:30.574716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cf66b-550b-495d-b5e8-01d8ba3e8f90 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.575067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cf66b-550b-495d-b5e8-01d8ba3e8f90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.575408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cf66b-550b-495d-b5e8-01d8ba3e8f90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.586089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cf66b-550b-495d-b5e8-01d8ba3e8f90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:30.587841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cf66b-550b-495d-b5e8-01d8ba3e8f90 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:30.598963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 974/1956] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:30.689383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d0736-7faa-4241-b29c-fedddf34ab9b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:30.691610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-311d0736-7faa-4241-b29c-fedddf34ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:30.763443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d0736-7faa-4241-b29c-fedddf34ab9b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:30.769077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:30.770675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.770958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.771259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] PATH_INFO: `/v3/users/dd5f35c1a4474fbd9db8c69d437d21ec` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.772532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5f35c1a4474fbd9db8c69d437d21ec)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:30.774512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:30.823808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5f35c1a4474fbd9db8c69d437d21ec'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:30.831313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5f35c1a4474fbd9db8c69d437d21ec'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:30.839048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5f35c1a4474fbd9db8c69d437d21ec'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:30.851486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5f35c1a4474fbd9db8c69d437d21ec'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:30.852223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5f35c1a4474fbd9db8c69d437d21ec'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:30.858344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 983/1957] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:30 2022] DELETE /identity/v3/users/dd5f35c1a4474fbd9db8c69d437d21ec => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:30.863442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0c86-5bb1-429f-84c4-036ca223a298 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:30.863731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0c86-5bb1-429f-84c4-036ca223a298 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:30.864008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d0c86-5bb1-429f-84c4-036ca223a298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:30.890606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8c4d0c86-5bb1-429f-84c4-036ca223a298 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:30.891854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8c4d0c86-5bb1-429f-84c4-036ca223a298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:30.974875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 975/1958] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:30.989779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:30.992022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:31.058571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36973af-e13b-46c8-9cd4-fbc5ac3e3926 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:31.062344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44e2d7-a554-4da7-950f-1eec887ce45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:31.062981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e2d7-a554-4da7-950f-1eec887ce45f service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:31.063264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e2d7-a554-4da7-950f-1eec887ce45f service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:31.063523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44e2d7-a554-4da7-950f-1eec887ce45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:31.073981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44e2d7-a554-4da7-950f-1eec887ce45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:31.075466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44e2d7-a554-4da7-950f-1eec887ce45f service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:31.085729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 984/1959] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:31.350510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d0c86-5bb1-429f-84c4-036ca223a298 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:31.351978 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8c4d0c86-5bb1-429f-84c4-036ca223a298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:31.370798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d0c86-5bb1-429f-84c4-036ca223a298 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:31.376949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:31.377854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:31.378062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:31.378339 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] PATH_INFO: `/v3/projects/8513aa0bc8d94e31bdcec27a458325e8` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:31.379630 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8513aa0bc8d94e31bdcec27a458325e8)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:31.381539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:31.430883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8513aa0bc8d94e31bdcec27a458325e8', 'request_id': 'req-50457795-9abd-43d2-bcb1-7c982401afbe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.437229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8513aa0bc8d94e31bdcec27a458325e8', 'request_id': 'req-50457795-9abd-43d2-bcb1-7c982401afbe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.442983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8513aa0bc8d94e31bdcec27a458325e8', 'request_id': 'req-50457795-9abd-43d2-bcb1-7c982401afbe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.457683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] The token cache is being invalidate because project 8513aa0bc8d94e31bdcec27a458325e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:31.458081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.458989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.460578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 976/1960] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:31 2022] DELETE /identity/v3/projects/8513aa0bc8d94e31bdcec27a458325e8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:31.464637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44e2d7-a554-4da7-950f-1eec887ce45f service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:31.474990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44e2d7-a554-4da7-950f-1eec887ce45f service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:31.547551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:31.548463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:31.548747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:31.549024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] PATH_INFO: `/v3/users/b06b734280cd4927a358c93164aef49a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:31.550250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06b734280cd4927a358c93164aef49a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:31.552781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:31.615900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06b734280cd4927a358c93164aef49a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.641527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06b734280cd4927a358c93164aef49a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.645151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06b734280cd4927a358c93164aef49a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.661579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06b734280cd4927a358c93164aef49a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.662209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-498bdb73-b972-4439-84a8-da8e483f4c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06b734280cd4927a358c93164aef49a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:31.671224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 985/1961] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:31 2022] DELETE /identity/v3/users/b06b734280cd4927a358c93164aef49a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:31.974448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:31.979421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:32.011892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50457795-9abd-43d2-bcb1-7c982401afbe admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.079722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.080601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.080886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.081157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] PATH_INFO: `/v3/projects/beb88c1a2b60405c93d2551ce5eb49ea` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.083051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb88c1a2b60405c93d2551ce5eb49ea)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.085519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:32.136116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb88c1a2b60405c93d2551ce5eb49ea', 'request_id': 'req-dd16c92e-b71f-4c40-80d6-d6147f200bfd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:32.142942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb88c1a2b60405c93d2551ce5eb49ea', 'request_id': 'req-dd16c92e-b71f-4c40-80d6-d6147f200bfd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:32.150054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb88c1a2b60405c93d2551ce5eb49ea', 'request_id': 'req-dd16c92e-b71f-4c40-80d6-d6147f200bfd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:32.163142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] The token cache is being invalidate because project beb88c1a2b60405c93d2551ce5eb49ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:32.163477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:32.164130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-dd16c92e-b71f-4c40-80d6-d6147f200bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:32.165704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 977/1962] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:31 2022] DELETE /identity/v3/projects/beb88c1a2b60405c93d2551ce5eb49ea => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:32.171466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c85b-74d9-42ce-9928-531b3e392dd2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.171746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c85b-74d9-42ce-9928-531b3e392dd2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.172013 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c85b-74d9-42ce-9928-531b3e392dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.190863 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8e66c85b-74d9-42ce-9928-531b3e392dd2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:32.192642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8e66c85b-74d9-42ce-9928-531b3e392dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:32.252683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 986/1963] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:32.262602 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95eee-7df8-436f-bf95-8cca7e32d2ad None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.262981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95eee-7df8-436f-bf95-8cca7e32d2ad None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.263319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e95eee-7df8-436f-bf95-8cca7e32d2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.283038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c7e95eee-7df8-436f-bf95-8cca7e32d2ad None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:32.284311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c7e95eee-7df8-436f-bf95-8cca7e32d2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:32.292662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 978/1964] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:32.297018 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66c85b-74d9-42ce-9928-531b3e392dd2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:32.307228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66c85b-74d9-42ce-9928-531b3e392dd2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.312137 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a6063-89cf-4a4e-9e72-171671d4cae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.312963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a6063-89cf-4a4e-9e72-171671d4cae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.313244 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a6063-89cf-4a4e-9e72-171671d4cae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.313520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a6063-89cf-4a4e-9e72-171671d4cae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.314298 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a6063-89cf-4a4e-9e72-171671d4cae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:32.314622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a6063-89cf-4a4e-9e72-171671d4cae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.316823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a6063-89cf-4a4e-9e72-171671d4cae7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:32.332378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 987/1965] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:32.334297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95eee-7df8-436f-bf95-8cca7e32d2ad None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:32.343868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e95eee-7df8-436f-bf95-8cca7e32d2ad None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.350008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d214d-85e9-4e83-8d75-db320c11bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.351303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d214d-85e9-4e83-8d75-db320c11bc6f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.351590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d214d-85e9-4e83-8d75-db320c11bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.351930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d214d-85e9-4e83-8d75-db320c11bc6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.353688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d214d-85e9-4e83-8d75-db320c11bc6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.355677 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d214d-85e9-4e83-8d75-db320c11bc6f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:32.385182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 979/1966] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:32 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:32.389265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a6063-89cf-4a4e-9e72-171671d4cae7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:32.399782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a6063-89cf-4a4e-9e72-171671d4cae7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.458784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c28d4-bc3b-4524-b005-cc1ad648864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.459375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c28d4-bc3b-4524-b005-cc1ad648864a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.459653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c28d4-bc3b-4524-b005-cc1ad648864a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.459927 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c28d4-bc3b-4524-b005-cc1ad648864a admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.460662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c28d4-bc3b-4524-b005-cc1ad648864a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.462622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c28d4-bc3b-4524-b005-cc1ad648864a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:32.481724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 988/1967] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:32 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:32.486120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d214d-85e9-4e83-8d75-db320c11bc6f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:32.498111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d214d-85e9-4e83-8d75-db320c11bc6f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.502729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de95fd-8866-4fbe-950b-e7dd2954e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.503410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de95fd-8866-4fbe-950b-e7dd2954e4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.504301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de95fd-8866-4fbe-950b-e7dd2954e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.504600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de95fd-8866-4fbe-950b-e7dd2954e4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.505335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de95fd-8866-4fbe-950b-e7dd2954e4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.506917 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de95fd-8866-4fbe-950b-e7dd2954e4c9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:32.517325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 980/1968] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:32.521451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c28d4-bc3b-4524-b005-cc1ad648864a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:32.531129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c28d4-bc3b-4524-b005-cc1ad648864a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.535701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50ff6-6930-400a-a1e8-f8005a247402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.536366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50ff6-6930-400a-a1e8-f8005a247402 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.536878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50ff6-6930-400a-a1e8-f8005a247402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.537166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50ff6-6930-400a-a1e8-f8005a247402 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.537990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50ff6-6930-400a-a1e8-f8005a247402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.539589 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50ff6-6930-400a-a1e8-f8005a247402 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:32.549788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 989/1969] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:32.554724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de95fd-8866-4fbe-950b-e7dd2954e4c9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:32.564720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de95fd-8866-4fbe-950b-e7dd2954e4c9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.569984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6360f6-9b18-4b4d-9f21-3b4761e194ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.570856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6360f6-9b18-4b4d-9f21-3b4761e194ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.571142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6360f6-9b18-4b4d-9f21-3b4761e194ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.571420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6360f6-9b18-4b4d-9f21-3b4761e194ff admin admin] PATH_INFO: `/v3/projects/a29a72cebf74451aa2171fc1f8bbfb55/users/1ac9b7f64e654577a8c9ed64d168e3e8/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.585757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6360f6-9b18-4b4d-9f21-3b4761e194ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29a72cebf74451aa2171fc1f8bbfb55, user_id=1ac9b7f64e654577a8c9ed64d168e3e8, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.588433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6360f6-9b18-4b4d-9f21-3b4761e194ff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:32.602249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 981/1970] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:32 2022] PUT /identity/v3/projects/a29a72cebf74451aa2171fc1f8bbfb55/users/1ac9b7f64e654577a8c9ed64d168e3e8/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:32.612694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377677-693e-4d70-a7f4-10c694ad3a11 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.613515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377677-693e-4d70-a7f4-10c694ad3a11 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.613819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13377677-693e-4d70-a7f4-10c694ad3a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.644154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-13377677-693e-4d70-a7f4-10c694ad3a11 None None] MFA Rules not processed for user `1ac9b7f64e654577a8c9ed64d168e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:32.645716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-13377677-693e-4d70-a7f4-10c694ad3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:32.721358 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 990/1971] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:32.726257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6360f6-9b18-4b4d-9f21-3b4761e194ff admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:32.788724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6360f6-9b18-4b4d-9f21-3b4761e194ff admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.793494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658702e0-fd0f-4232-9a3c-7295a0bd8990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.794158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658702e0-fd0f-4232-9a3c-7295a0bd8990 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.794467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658702e0-fd0f-4232-9a3c-7295a0bd8990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.794773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658702e0-fd0f-4232-9a3c-7295a0bd8990 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.795481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658702e0-fd0f-4232-9a3c-7295a0bd8990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.797457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658702e0-fd0f-4232-9a3c-7295a0bd8990 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:32.825239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 982/1972] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:32 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:32.829468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13377677-693e-4d70-a7f4-10c694ad3a11 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:32.843325 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13377677-693e-4d70-a7f4-10c694ad3a11 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.912181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50657394-b772-4f88-9285-4bcaf620af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.912518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50657394-b772-4f88-9285-4bcaf620af62 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.915699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50657394-b772-4f88-9285-4bcaf620af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.915699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50657394-b772-4f88-9285-4bcaf620af62 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.915699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50657394-b772-4f88-9285-4bcaf620af62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.916551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50657394-b772-4f88-9285-4bcaf620af62 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:32.940070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 991/1973] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:32 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:32.943916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658702e0-fd0f-4232-9a3c-7295a0bd8990 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:32.957129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658702e0-fd0f-4232-9a3c-7295a0bd8990 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:32.979730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c1793-8d0d-4210-9ef3-5ecc7fafc4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:32.980365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1793-8d0d-4210-9ef3-5ecc7fafc4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:32.980585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1793-8d0d-4210-9ef3-5ecc7fafc4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:32.981034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1793-8d0d-4210-9ef3-5ecc7fafc4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:32.981892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c1793-8d0d-4210-9ef3-5ecc7fafc4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:32.986609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c1793-8d0d-4210-9ef3-5ecc7fafc4a0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:33.001888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 983/1974] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:33.004413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50657394-b772-4f88-9285-4bcaf620af62 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.019868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50657394-b772-4f88-9285-4bcaf620af62 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:33.027577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aff9c-91cd-4021-a488-4cd94989a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:33.029127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aff9c-91cd-4021-a488-4cd94989a4b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.029407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aff9c-91cd-4021-a488-4cd94989a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.029955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aff9c-91cd-4021-a488-4cd94989a4b1 admin admin] PATH_INFO: `/v3/projects/b70831f5875742b5abd3a11e065af8e0/users/fb485a3ae5344d488225279747a2e0d9/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.055993 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aff9c-91cd-4021-a488-4cd94989a4b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70831f5875742b5abd3a11e065af8e0, user_id=fb485a3ae5344d488225279747a2e0d9, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:33.060023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aff9c-91cd-4021-a488-4cd94989a4b1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:33.078800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 992/1975] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:33 2022] PUT /identity/v3/projects/b70831f5875742b5abd3a11e065af8e0/users/fb485a3ae5344d488225279747a2e0d9/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:33.083148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c1793-8d0d-4210-9ef3-5ecc7fafc4a0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.094736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c1793-8d0d-4210-9ef3-5ecc7fafc4a0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:33.164167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872adbb0-2b79-4338-85ea-ae1b0502732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:33.164872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872adbb0-2b79-4338-85ea-ae1b0502732c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.165310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872adbb0-2b79-4338-85ea-ae1b0502732c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.165596 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872adbb0-2b79-4338-85ea-ae1b0502732c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.166336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872adbb0-2b79-4338-85ea-ae1b0502732c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:33.167925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872adbb0-2b79-4338-85ea-ae1b0502732c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:33.180788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 984/1976] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:33.181913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aff9c-91cd-4021-a488-4cd94989a4b1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.192061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aff9c-91cd-4021-a488-4cd94989a4b1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:33.197653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb616f-5d5c-4b29-ad2d-6adf32688a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:33.198861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb616f-5d5c-4b29-ad2d-6adf32688a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.199091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb616f-5d5c-4b29-ad2d-6adf32688a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.199365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb616f-5d5c-4b29-ad2d-6adf32688a5d admin admin] PATH_INFO: `/v3/projects/b70831f5875742b5abd3a11e065af8e0/users/fb485a3ae5344d488225279747a2e0d9/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.201695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb616f-5d5c-4b29-ad2d-6adf32688a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70831f5875742b5abd3a11e065af8e0, user_id=fb485a3ae5344d488225279747a2e0d9, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:33.204994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb616f-5d5c-4b29-ad2d-6adf32688a5d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:33.209977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872adbb0-2b79-4338-85ea-ae1b0502732c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.212090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-872adbb0-2b79-4338-85ea-ae1b0502732c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.218682 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 993/1977] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:33 2022] PUT /identity/v3/projects/b70831f5875742b5abd3a11e065af8e0/users/fb485a3ae5344d488225279747a2e0d9/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:33.227953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872adbb0-2b79-4338-85ea-ae1b0502732c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:33.229677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e459b9-5708-4e87-b6d2-5c4c018ed642 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.229969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e459b9-5708-4e87-b6d2-5c4c018ed642 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.230337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e459b9-5708-4e87-b6d2-5c4c018ed642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.267434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e0e459b9-5708-4e87-b6d2-5c4c018ed642 None None] MFA Rules not processed for user `fb485a3ae5344d488225279747a2e0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:33.268700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e0e459b9-5708-4e87-b6d2-5c4c018ed642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.298189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:33.299089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.299980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.300266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] PATH_INFO: `/v3/users/927e07ce3bc04561af5348f172bc770e` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.301656 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=927e07ce3bc04561af5348f172bc770e)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:33.303888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:33.360174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 994/1978] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:33.365173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927e07ce3bc04561af5348f172bc770e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.371225 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e459b9-5708-4e87-b6d2-5c4c018ed642 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.372706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927e07ce3bc04561af5348f172bc770e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.373319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e0e459b9-5708-4e87-b6d2-5c4c018ed642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.386826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927e07ce3bc04561af5348f172bc770e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.387654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927e07ce3bc04561af5348f172bc770e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.399864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1ebe8259-cbd6-4c32-8817-ea1272bac2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927e07ce3bc04561af5348f172bc770e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.411051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 985/1979] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:33 2022] DELETE /identity/v3/users/927e07ce3bc04561af5348f172bc770e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:33.415027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d31a-77ba-43f1-b2be-89ea2e596871 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.415546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d31a-77ba-43f1-b2be-89ea2e596871 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.416043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5d31a-77ba-43f1-b2be-89ea2e596871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.433919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-25a5d31a-77ba-43f1-b2be-89ea2e596871 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:33.435105 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-25a5d31a-77ba-43f1-b2be-89ea2e596871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.445181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e459b9-5708-4e87-b6d2-5c4c018ed642 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:33.496903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:33.497739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.498080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.498354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.500709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.501198 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 986/1980] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:33.511134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d31a-77ba-43f1-b2be-89ea2e596871 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.514057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-25a5d31a-77ba-43f1-b2be-89ea2e596871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.572091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:33.574018 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:33.574278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5d31a-77ba-43f1-b2be-89ea2e596871 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:33.578253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e3e54-d0bf-469e-a812-aca00e77c155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:33.579398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e3e54-d0bf-469e-a812-aca00e77c155 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.579398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e3e54-d0bf-469e-a812-aca00e77c155 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.579595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e3e54-d0bf-469e-a812-aca00e77c155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.588463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 995/1981] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:33.592088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e3e54-d0bf-469e-a812-aca00e77c155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:33.593221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e3e54-d0bf-469e-a812-aca00e77c155 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:33.604196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 987/1982] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:33.630113 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.631576 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.649163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5831-fe1c-4b80-92a0-9f86ab1efae3 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:33.657839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:33.658718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.658999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.659274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] PATH_INFO: `/v3/users/99d300d31242482da2e6a956f37a98c6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.660842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d300d31242482da2e6a956f37a98c6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:33.663112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:33.700009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e3e54-d0bf-469e-a812-aca00e77c155 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.702218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-935e3e54-d0bf-469e-a812-aca00e77c155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.721024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e3e54-d0bf-469e-a812-aca00e77c155 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:33.727602 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:33.728751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.728861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.729048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] PATH_INFO: `/v3/users/1ac9b7f64e654577a8c9ed64d168e3e8` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.730525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac9b7f64e654577a8c9ed64d168e3e8)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:33.732822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:33.736930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d300d31242482da2e6a956f37a98c6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.746082 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d300d31242482da2e6a956f37a98c6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.755036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d300d31242482da2e6a956f37a98c6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.768067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d300d31242482da2e6a956f37a98c6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.768849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1d7a75ae-9616-4398-a0c0-0660cd582135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d300d31242482da2e6a956f37a98c6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.781431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 996/1983] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:33 2022] DELETE /identity/v3/users/99d300d31242482da2e6a956f37a98c6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:33.797171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac9b7f64e654577a8c9ed64d168e3e8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.806025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac9b7f64e654577a8c9ed64d168e3e8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.821505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac9b7f64e654577a8c9ed64d168e3e8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.822287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac9b7f64e654577a8c9ed64d168e3e8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.832276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac9b7f64e654577a8c9ed64d168e3e8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:33.840149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 988/1984] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:33 2022] DELETE /identity/v3/users/1ac9b7f64e654577a8c9ed64d168e3e8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:33.845191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87cc2-7a2e-46d1-97b4-e17256eb6372 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:33.845555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87cc2-7a2e-46d1-97b4-e17256eb6372 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:33.845903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87cc2-7a2e-46d1-97b4-e17256eb6372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:33.864730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-11f87cc2-7a2e-46d1-97b4-e17256eb6372 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:33.866238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-11f87cc2-7a2e-46d1-97b4-e17256eb6372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.924195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.926254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:33.950679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 997/1985] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:33.966068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87cc2-7a2e-46d1-97b4-e17256eb6372 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:33.968408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-11f87cc2-7a2e-46d1-97b4-e17256eb6372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.031187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22761fa4-c88b-45ff-b434-4a8e963a506b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.036908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.037990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.038311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.038585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] PATH_INFO: `/v3/projects/5b55ce70ae4b48179e1c49ff2685eb88` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.039242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87cc2-7a2e-46d1-97b4-e17256eb6372 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.040135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b55ce70ae4b48179e1c49ff2685eb88)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.042483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.044628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13630e-d894-48eb-bd4b-cb4d2e8f1061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.045295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13630e-d894-48eb-bd4b-cb4d2e8f1061 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.045579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13630e-d894-48eb-bd4b-cb4d2e8f1061 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.045929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13630e-d894-48eb-bd4b-cb4d2e8f1061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.057092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13630e-d894-48eb-bd4b-cb4d2e8f1061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.058561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13630e-d894-48eb-bd4b-cb4d2e8f1061 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.077177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 998/1986] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:34.077177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13630e-d894-48eb-bd4b-cb4d2e8f1061 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.078806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fd13630e-d894-48eb-bd4b-cb4d2e8f1061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.094134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13630e-d894-48eb-bd4b-cb4d2e8f1061 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.105729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b55ce70ae4b48179e1c49ff2685eb88', 'request_id': 'req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.114233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b55ce70ae4b48179e1c49ff2685eb88', 'request_id': 'req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.141088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b55ce70ae4b48179e1c49ff2685eb88', 'request_id': 'req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.162222 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] The token cache is being invalidate because project 5b55ce70ae4b48179e1c49ff2685eb88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:34.162514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.164061 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.166826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 989/1987] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:33 2022] DELETE /identity/v3/projects/5b55ce70ae4b48179e1c49ff2685eb88 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:34.167678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.179826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.185002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.185817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.186099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.186371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] PATH_INFO: `/v3/projects/8eff6e04661341908c55f615610f0336` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.188249 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eff6e04661341908c55f615610f0336)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.190460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.241387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf1b5-31e2-4e8e-ba91-85a3825b44a2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.251945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eff6e04661341908c55f615610f0336', 'request_id': 'req-2cdc3017-319d-48f2-a395-47c9ce85b22f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.260835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eff6e04661341908c55f615610f0336', 'request_id': 'req-2cdc3017-319d-48f2-a395-47c9ce85b22f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.271168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eff6e04661341908c55f615610f0336', 'request_id': 'req-2cdc3017-319d-48f2-a395-47c9ce85b22f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.284527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] The token cache is being invalidate because project 8eff6e04661341908c55f615610f0336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:34.286066 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.286852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2cdc3017-319d-48f2-a395-47c9ce85b22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.288518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 999/1988] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:34 2022] DELETE /identity/v3/projects/8eff6e04661341908c55f615610f0336 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:34.293837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242f78e-8ba2-454d-ad7b-10b7aab9e60f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.294135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242f78e-8ba2-454d-ad7b-10b7aab9e60f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.294417 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242f78e-8ba2-454d-ad7b-10b7aab9e60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.298616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.299839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.300305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.301411 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.304176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.313723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5242f78e-8ba2-454d-ad7b-10b7aab9e60f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:34.314937 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5242f78e-8ba2-454d-ad7b-10b7aab9e60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.390175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.391897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.402477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1000/1989] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:34.403514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 990/1990] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:34.404080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bb3cc-da76-40a8-980d-8e5732f83cd0 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.404388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bb3cc-da76-40a8-980d-8e5732f83cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.404576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.404687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bb3cc-da76-40a8-980d-8e5732f83cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.406329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.424322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028629d-ae8a-4e34-a5c0-05aa335c83e0 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.430539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.431531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.431907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.432191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] PATH_INFO: `/v3/projects/a29a72cebf74451aa2171fc1f8bbfb55` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.432955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-186bb3cc-da76-40a8-980d-8e5732f83cd0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:34.433444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29a72cebf74451aa2171fc1f8bbfb55)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.434359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-186bb3cc-da76-40a8-980d-8e5732f83cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.435478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.451981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1001/1991] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:34.454265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c6bf-6223-44f9-a1ff-1a5904fc45d6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.454934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c6bf-6223-44f9-a1ff-1a5904fc45d6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.454934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c6bf-6223-44f9-a1ff-1a5904fc45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.487603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d767c6bf-6223-44f9-a1ff-1a5904fc45d6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:34.489581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d767c6bf-6223-44f9-a1ff-1a5904fc45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.510581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1002/1992] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:34.511891 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0794-d18d-467e-bdfa-6c810953edd8 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.512177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0794-d18d-467e-bdfa-6c810953edd8 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.512489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce0794-d18d-467e-bdfa-6c810953edd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.521499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29a72cebf74451aa2171fc1f8bbfb55', 'request_id': 'req-33a19642-dca1-43d9-9adf-04f39978b8aa'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.529426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29a72cebf74451aa2171fc1f8bbfb55', 'request_id': 'req-33a19642-dca1-43d9-9adf-04f39978b8aa'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.537550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29a72cebf74451aa2171fc1f8bbfb55', 'request_id': 'req-33a19642-dca1-43d9-9adf-04f39978b8aa'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.544539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-50ce0794-d18d-467e-bdfa-6c810953edd8 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:34.545825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-50ce0794-d18d-467e-bdfa-6c810953edd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.567876 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] The token cache is being invalidate because project a29a72cebf74451aa2171fc1f8bbfb55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:34.568566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.571674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.575793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 991/1993] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:34 2022] DELETE /identity/v3/projects/a29a72cebf74451aa2171fc1f8bbfb55 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:34.576890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.578692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.650700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1003/1994] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:34.651545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce0794-d18d-467e-bdfa-6c810953edd8 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.653793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-50ce0794-d18d-467e-bdfa-6c810953edd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.661402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19642-dca1-43d9-9adf-04f39978b8aa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.666689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaa020-460f-40a7-91f7-39bc0d5e0f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.667500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa020-460f-40a7-91f7-39bc0d5e0f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.667860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa020-460f-40a7-91f7-39bc0d5e0f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.668213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaa020-460f-40a7-91f7-39bc0d5e0f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.669094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaa020-460f-40a7-91f7-39bc0d5e0f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:34.669404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaa020-460f-40a7-91f7-39bc0d5e0f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.671131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaa020-460f-40a7-91f7-39bc0d5e0f39 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.674910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce0794-d18d-467e-bdfa-6c810953edd8 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.683789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.684046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 992/1995] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:34.684946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaa020-460f-40a7-91f7-39bc0d5e0f39 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.688441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.688776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.689074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] PATH_INFO: `/v3/users/fb485a3ae5344d488225279747a2e0d9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.690373 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb485a3ae5344d488225279747a2e0d9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.692687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.695289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaa020-460f-40a7-91f7-39bc0d5e0f39 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.701450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d182a8-fca4-4cdb-9c17-c9d8f8831866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.702248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d182a8-fca4-4cdb-9c17-c9d8f8831866 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.702607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d182a8-fca4-4cdb-9c17-c9d8f8831866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.702993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d182a8-fca4-4cdb-9c17-c9d8f8831866 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.703805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d182a8-fca4-4cdb-9c17-c9d8f8831866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:34.704142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d182a8-fca4-4cdb-9c17-c9d8f8831866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.705940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d182a8-fca4-4cdb-9c17-c9d8f8831866 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.721973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 993/1996] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:34.723442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d182a8-fca4-4cdb-9c17-c9d8f8831866 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.735786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d182a8-fca4-4cdb-9c17-c9d8f8831866 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.741416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe16614-f78d-4f48-b2ec-f40eee6f7208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.742563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe16614-f78d-4f48-b2ec-f40eee6f7208 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.742853 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe16614-f78d-4f48-b2ec-f40eee6f7208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.743143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe16614-f78d-4f48-b2ec-f40eee6f7208 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.744256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe16614-f78d-4f48-b2ec-f40eee6f7208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.746384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe16614-f78d-4f48-b2ec-f40eee6f7208 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.761051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb485a3ae5344d488225279747a2e0d9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.774207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb485a3ae5344d488225279747a2e0d9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.786446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 994/1997] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:34 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:34.787287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe16614-f78d-4f48-b2ec-f40eee6f7208 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.787750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb485a3ae5344d488225279747a2e0d9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.803699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb485a3ae5344d488225279747a2e0d9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.805101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb485a3ae5344d488225279747a2e0d9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:34.812673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1004/1998] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:34 2022] DELETE /identity/v3/users/fb485a3ae5344d488225279747a2e0d9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:34.814438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.816223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.895034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe16614-f78d-4f48-b2ec-f40eee6f7208 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.900788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e355f16-dee7-4248-88b9-1a57f598cca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.901735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e355f16-dee7-4248-88b9-1a57f598cca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.902191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e355f16-dee7-4248-88b9-1a57f598cca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.902850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e355f16-dee7-4248-88b9-1a57f598cca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.903749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e355f16-dee7-4248-88b9-1a57f598cca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.904108 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b41c6-334d-429d-8ec3-a19e6c07638d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:34.906785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e355f16-dee7-4248-88b9-1a57f598cca1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.910787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964e348-6749-4052-8547-194bcb1e1780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:34.911531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e348-6749-4052-8547-194bcb1e1780 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:34.912255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e348-6749-4052-8547-194bcb1e1780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:34.912788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e348-6749-4052-8547-194bcb1e1780 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:34.913666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e348-6749-4052-8547-194bcb1e1780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:34.916703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e348-6749-4052-8547-194bcb1e1780 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:34.948838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1005/1999] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:34 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:34.950319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964e348-6749-4052-8547-194bcb1e1780 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.959734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 995/2000] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:34 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:34.963993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e355f16-dee7-4248-88b9-1a57f598cca1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:34.966038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7e355f16-dee7-4248-88b9-1a57f598cca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:34.971365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964e348-6749-4052-8547-194bcb1e1780 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.040973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e355f16-dee7-4248-88b9-1a57f598cca1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.047476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f03be9-fc7b-480e-a0a9-edf93be7ec20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.048259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f03be9-fc7b-480e-a0a9-edf93be7ec20 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.048697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f03be9-fc7b-480e-a0a9-edf93be7ec20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.049169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f03be9-fc7b-480e-a0a9-edf93be7ec20 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.050157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f03be9-fc7b-480e-a0a9-edf93be7ec20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.053001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f03be9-fc7b-480e-a0a9-edf93be7ec20 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.072531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a59d39-1a92-4a6a-aaf6-2e319d21b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.073506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a59d39-1a92-4a6a-aaf6-2e319d21b644 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.073783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a59d39-1a92-4a6a-aaf6-2e319d21b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.074054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a59d39-1a92-4a6a-aaf6-2e319d21b644 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.074793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a59d39-1a92-4a6a-aaf6-2e319d21b644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.076420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a59d39-1a92-4a6a-aaf6-2e319d21b644 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.078704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 996/2001] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:34 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:35.083012 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f03be9-fc7b-480e-a0a9-edf93be7ec20 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.089859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1006/2002] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:35.093156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f03be9-fc7b-480e-a0a9-edf93be7ec20 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.093500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a59d39-1a92-4a6a-aaf6-2e319d21b644 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.097967 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126bdc-2ad6-4a43-954f-525b111b10bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.098637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126bdc-2ad6-4a43-954f-525b111b10bd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.098921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126bdc-2ad6-4a43-954f-525b111b10bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.099213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126bdc-2ad6-4a43-954f-525b111b10bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.100094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82126bdc-2ad6-4a43-954f-525b111b10bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.102033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82126bdc-2ad6-4a43-954f-525b111b10bd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.108705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a59d39-1a92-4a6a-aaf6-2e319d21b644 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.115378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 997/2003] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:35.115522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c91d-0647-4914-9721-ae7ca7fd0571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.116177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c91d-0647-4914-9721-ae7ca7fd0571 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.116623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c91d-0647-4914-9721-ae7ca7fd0571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.116905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37c91d-0647-4914-9721-ae7ca7fd0571 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.118313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c91d-0647-4914-9721-ae7ca7fd0571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.119297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126bdc-2ad6-4a43-954f-525b111b10bd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.120780 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37c91d-0647-4914-9721-ae7ca7fd0571 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.132220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1007/2004] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:35.132786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126bdc-2ad6-4a43-954f-525b111b10bd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.136385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c91d-0647-4914-9721-ae7ca7fd0571 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.137974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f6b02-107a-4c34-9800-9ae7b23c84ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.138709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f6b02-107a-4c34-9800-9ae7b23c84ab admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.139066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f6b02-107a-4c34-9800-9ae7b23c84ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.139442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f6b02-107a-4c34-9800-9ae7b23c84ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.140391 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f6b02-107a-4c34-9800-9ae7b23c84ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.142054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f6b02-107a-4c34-9800-9ae7b23c84ab admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.148704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37c91d-0647-4914-9721-ae7ca7fd0571 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.154842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfb96c-09f8-4637-b4cb-d5f74af32126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.156222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfb96c-09f8-4637-b4cb-d5f74af32126 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.156560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfb96c-09f8-4637-b4cb-d5f74af32126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.156982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfb96c-09f8-4637-b4cb-d5f74af32126 admin admin] PATH_INFO: `/v3/projects/46db12943b7e4c8cb32f490a9d91ea0c/users/78baffba33c44ea792851dcb1ebf8209/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.159086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 998/2005] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:35.159856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f6b02-107a-4c34-9800-9ae7b23c84ab admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.169963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f6b02-107a-4c34-9800-9ae7b23c84ab admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.175211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb6488-3f3a-44d8-ad34-79ffc1082654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.175872 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfb96c-09f8-4637-b4cb-d5f74af32126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46db12943b7e4c8cb32f490a9d91ea0c, user_id=78baffba33c44ea792851dcb1ebf8209, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.176119 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6488-3f3a-44d8-ad34-79ffc1082654 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.176433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6488-3f3a-44d8-ad34-79ffc1082654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.176709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6488-3f3a-44d8-ad34-79ffc1082654 admin admin] PATH_INFO: `/v3/projects/55e0d7dfde424042b59a69788e8db645/users/98edec8ed72746169a45a5cfaaafd247/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.179557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfb96c-09f8-4637-b4cb-d5f74af32126 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.195915 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb6488-3f3a-44d8-ad34-79ffc1082654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e0d7dfde424042b59a69788e8db645, user_id=98edec8ed72746169a45a5cfaaafd247, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.198858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb6488-3f3a-44d8-ad34-79ffc1082654 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.203938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1008/2006] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:35 2022] PUT /identity/v3/projects/46db12943b7e4c8cb32f490a9d91ea0c/users/78baffba33c44ea792851dcb1ebf8209/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:35.216522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8d771-54f5-481f-a4a0-6ee52cf704eb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.217971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8d771-54f5-481f-a4a0-6ee52cf704eb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.218295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8d771-54f5-481f-a4a0-6ee52cf704eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.232873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 999/2007] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:35 2022] PUT /identity/v3/projects/55e0d7dfde424042b59a69788e8db645/users/98edec8ed72746169a45a5cfaaafd247/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:35.238479 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2abbb-e1f6-4023-a37c-5b6967f6866c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.238841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2abbb-e1f6-4023-a37c-5b6967f6866c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.239515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2abbb-e1f6-4023-a37c-5b6967f6866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.267364 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-90b8d771-54f5-481f-a4a0-6ee52cf704eb None None] MFA Rules not processed for user `78baffba33c44ea792851dcb1ebf8209`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:35.270702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-97c2abbb-e1f6-4023-a37c-5b6967f6866c None None] MFA Rules not processed for user `98edec8ed72746169a45a5cfaaafd247`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:35.271092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-90b8d771-54f5-481f-a4a0-6ee52cf704eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:35.271967 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-97c2abbb-e1f6-4023-a37c-5b6967f6866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:35.358125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1009/2008] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:35.359218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1000/2009] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:35.359352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8d771-54f5-481f-a4a0-6ee52cf704eb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.359352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-90b8d771-54f5-481f-a4a0-6ee52cf704eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:35.359490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2abbb-e1f6-4023-a37c-5b6967f6866c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.419810 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8d771-54f5-481f-a4a0-6ee52cf704eb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.423668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2abbb-e1f6-4023-a37c-5b6967f6866c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.424705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.426186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.426464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.426737 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] PATH_INFO: `/v3/projects/b70831f5875742b5abd3a11e065af8e0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.427918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70831f5875742b5abd3a11e065af8e0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.428798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39099ec-ce39-4a69-a8d7-ce2951682d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.429446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39099ec-ce39-4a69-a8d7-ce2951682d5b admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.429723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39099ec-ce39-4a69-a8d7-ce2951682d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.429875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.429991 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39099ec-ce39-4a69-a8d7-ce2951682d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.430686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39099ec-ce39-4a69-a8d7-ce2951682d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.432641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39099ec-ce39-4a69-a8d7-ce2951682d5b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.460154 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1001/2010] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:35 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:35.461021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39099ec-ce39-4a69-a8d7-ce2951682d5b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.462596 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c39099ec-ce39-4a69-a8d7-ce2951682d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:35.477340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70831f5875742b5abd3a11e065af8e0', 'request_id': 'req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:35.483252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70831f5875742b5abd3a11e065af8e0', 'request_id': 'req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:35.490776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70831f5875742b5abd3a11e065af8e0', 'request_id': 'req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:35.500754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] The token cache is being invalidate because project b70831f5875742b5abd3a11e065af8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:35.501058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:35.501686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:35.507684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1010/2011] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:35 2022] DELETE /identity/v3/projects/b70831f5875742b5abd3a11e065af8e0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:35.507684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.507684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:35.518552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39099ec-ce39-4a69-a8d7-ce2951682d5b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.565624 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95f15-d194-4bec-99df-e0752f847eb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '612a02fb42af490abcba0e75ec8c759f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.566806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95f15-d194-4bec-99df-e0752f847eb0 service glance] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.567083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95f15-d194-4bec-99df-e0752f847eb0 service glance] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.567352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95f15-d194-4bec-99df-e0752f847eb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.568481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7f24f-c8a2-48cb-ac7b-037ce9edf1d2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.569200 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3da95f15-d194-4bec-99df-e0752f847eb0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:35.573345 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f05b7-1d4d-4d9d-a345-115f939e2586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.573997 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f05b7-1d4d-4d9d-a345-115f939e2586 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.574275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f05b7-1d4d-4d9d-a345-115f939e2586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.574548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f05b7-1d4d-4d9d-a345-115f939e2586 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.575237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f05b7-1d4d-4d9d-a345-115f939e2586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.577230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f05b7-1d4d-4d9d-a345-115f939e2586 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.596696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1011/2012] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:35 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:35.597973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84d51a-bc9d-4cc6-8cbf-236bf9adc6ee None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.598273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84d51a-bc9d-4cc6-8cbf-236bf9adc6ee None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.598518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84d51a-bc9d-4cc6-8cbf-236bf9adc6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.617467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fa84d51a-bc9d-4cc6-8cbf-236bf9adc6ee None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:35.618645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fa84d51a-bc9d-4cc6-8cbf-236bf9adc6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:35.626678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1012/2013] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:35.634864 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84d51a-bc9d-4cc6-8cbf-236bf9adc6ee None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.634968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da95f15-d194-4bec-99df-e0752f847eb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.634968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da95f15-d194-4bec-99df-e0752f847eb0 service glance] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.639278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84d51a-bc9d-4cc6-8cbf-236bf9adc6ee None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.639998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1002/2014] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:35.641454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1784b3-c549-4adb-8fba-20a16e129de9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.641749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1784b3-c549-4adb-8fba-20a16e129de9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.642030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1784b3-c549-4adb-8fba-20a16e129de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.644544 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df87d37-eb12-4ffd-9651-4f40ba6be4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.645346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df87d37-eb12-4ffd-9651-4f40ba6be4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.645630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df87d37-eb12-4ffd-9651-4f40ba6be4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.646010 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df87d37-eb12-4ffd-9651-4f40ba6be4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.646779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df87d37-eb12-4ffd-9651-4f40ba6be4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.648539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df87d37-eb12-4ffd-9651-4f40ba6be4b5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.658942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1013/2015] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:35.662810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8e1784b3-c549-4adb-8fba-20a16e129de9 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:35.664009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8e1784b3-c549-4adb-8fba-20a16e129de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:35.667461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df87d37-eb12-4ffd-9651-4f40ba6be4b5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.679308 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df87d37-eb12-4ffd-9651-4f40ba6be4b5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.686665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef86ad-3c40-434b-9a2b-a72b3a551261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.687560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef86ad-3c40-434b-9a2b-a72b3a551261 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.688191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef86ad-3c40-434b-9a2b-a72b3a551261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.688640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef86ad-3c40-434b-9a2b-a72b3a551261 admin admin] PATH_INFO: `/v3/projects/0593e084f1d346878c8ce511a1757421/users/b8b414ebe8d444dfb3e65c17e5f3e062/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.689366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1003/2016] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:35.696530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1784b3-c549-4adb-8fba-20a16e129de9 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.706661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1784b3-c549-4adb-8fba-20a16e129de9 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.710344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef86ad-3c40-434b-9a2b-a72b3a551261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0593e084f1d346878c8ce511a1757421, user_id=b8b414ebe8d444dfb3e65c17e5f3e062, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.713098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef86ad-3c40-434b-9a2b-a72b3a551261 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.719700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b7b0-55ba-48ed-a797-96d68fad3ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.720538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b7b0-55ba-48ed-a797-96d68fad3ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.720912 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b7b0-55ba-48ed-a797-96d68fad3ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.721332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099b7b0-55ba-48ed-a797-96d68fad3ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.723099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099b7b0-55ba-48ed-a797-96d68fad3ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:35.723445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099b7b0-55ba-48ed-a797-96d68fad3ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.725299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099b7b0-55ba-48ed-a797-96d68fad3ff4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.733778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1014/2017] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:35 2022] PUT /identity/v3/projects/0593e084f1d346878c8ce511a1757421/users/b8b414ebe8d444dfb3e65c17e5f3e062/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:35.737579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef86ad-3c40-434b-9a2b-a72b3a551261 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.744554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1004/2018] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:41:35.748716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b7b0-55ba-48ed-a797-96d68fad3ff4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.761604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099b7b0-55ba-48ed-a797-96d68fad3ff4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.829048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef86ad-3c40-434b-9a2b-a72b3a551261 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.837090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847602-a16a-4c34-9dfd-d7e693391519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.837412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847602-a16a-4c34-9dfd-d7e693391519 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.837666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847602-a16a-4c34-9dfd-d7e693391519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.837944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847602-a16a-4c34-9dfd-d7e693391519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.842378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4847602-a16a-4c34-9dfd-d7e693391519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.844096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4847602-a16a-4c34-9dfd-d7e693391519 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.857611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10efbef-7b64-43a8-8d64-80ebff779027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.858133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1015/2019] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:35.860737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10efbef-7b64-43a8-8d64-80ebff779027 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.861189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10efbef-7b64-43a8-8d64-80ebff779027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.862567 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847602-a16a-4c34-9dfd-d7e693391519 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.863726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10efbef-7b64-43a8-8d64-80ebff779027 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.864485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10efbef-7b64-43a8-8d64-80ebff779027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.867555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10efbef-7b64-43a8-8d64-80ebff779027 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.878386 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847602-a16a-4c34-9dfd-d7e693391519 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:35.887537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77e373-fafe-4064-9599-7b9ca7dcae2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:35.888831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77e373-fafe-4064-9599-7b9ca7dcae2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.889357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77e373-fafe-4064-9599-7b9ca7dcae2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.889791 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77e373-fafe-4064-9599-7b9ca7dcae2e admin admin] PATH_INFO: `/v3/projects/0593e084f1d346878c8ce511a1757421/users/b8b414ebe8d444dfb3e65c17e5f3e062/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.892778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77e373-fafe-4064-9599-7b9ca7dcae2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0593e084f1d346878c8ce511a1757421, user_id=b8b414ebe8d444dfb3e65c17e5f3e062, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:35.896530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77e373-fafe-4064-9599-7b9ca7dcae2e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:35.920998 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1016/2020] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:35 2022] PUT /identity/v3/projects/0593e084f1d346878c8ce511a1757421/users/b8b414ebe8d444dfb3e65c17e5f3e062/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:35.927703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1005/2021] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:35 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:35.927849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9880-7ba6-424f-89bb-0876123046c2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:35.927849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9880-7ba6-424f-89bb-0876123046c2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:35.927849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac9880-7ba6-424f-89bb-0876123046c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:35.929510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10efbef-7b64-43a8-8d64-80ebff779027 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:35.958260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e6ac9880-7ba6-424f-89bb-0876123046c2 None None] MFA Rules not processed for user `b8b414ebe8d444dfb3e65c17e5f3e062`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:35.959468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e6ac9880-7ba6-424f-89bb-0876123046c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:36.014176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10efbef-7b64-43a8-8d64-80ebff779027 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.032605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0c008-b096-4d59-ad0f-45b7caffaf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.033291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c008-b096-4d59-ad0f-45b7caffaf81 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.033572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c008-b096-4d59-ad0f-45b7caffaf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.033902 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0c008-b096-4d59-ad0f-45b7caffaf81 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.035207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0c008-b096-4d59-ad0f-45b7caffaf81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.037052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0c008-b096-4d59-ad0f-45b7caffaf81 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.062359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1006/2022] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:35 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:36.067641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0c008-b096-4d59-ad0f-45b7caffaf81 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.075600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1017/2023] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:36.079444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0c008-b096-4d59-ad0f-45b7caffaf81 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.085176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e8e9c-9c90-4272-a03e-ce4aae8f341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.085914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e8e9c-9c90-4272-a03e-ce4aae8f341c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.086207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e8e9c-9c90-4272-a03e-ce4aae8f341c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.086607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e8e9c-9c90-4272-a03e-ce4aae8f341c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.087405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e8e9c-9c90-4272-a03e-ce4aae8f341c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.089356 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e8e9c-9c90-4272-a03e-ce4aae8f341c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.103151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9880-7ba6-424f-89bb-0876123046c2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.104397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1007/2024] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:36.105205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e6ac9880-7ba6-424f-89bb-0876123046c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:36.107549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e8e9c-9c90-4272-a03e-ce4aae8f341c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.118979 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e8e9c-9c90-4272-a03e-ce4aae8f341c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.125302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19bae-28f8-4daa-a2da-cb55ef48951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.125972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19bae-28f8-4daa-a2da-cb55ef48951f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.126254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19bae-28f8-4daa-a2da-cb55ef48951f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.126531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d19bae-28f8-4daa-a2da-cb55ef48951f admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.127265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d19bae-28f8-4daa-a2da-cb55ef48951f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.129007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d19bae-28f8-4daa-a2da-cb55ef48951f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.155086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1008/2025] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:36.156158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19bae-28f8-4daa-a2da-cb55ef48951f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.167281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d19bae-28f8-4daa-a2da-cb55ef48951f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.171663 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295e903-48cd-4bfb-91d1-fe9293171161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.172628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e903-48cd-4bfb-91d1-fe9293171161 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.172888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e903-48cd-4bfb-91d1-fe9293171161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.173288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e903-48cd-4bfb-91d1-fe9293171161 admin admin] PATH_INFO: `/v3/projects/3df0f4782b1e410b8f4b8810c880b9f6/users/12475b431fc849cca75f22db1dd1ffcd/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.175628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac9880-7ba6-424f-89bb-0876123046c2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.180376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890b2e3-bd3b-46c7-8d12-d8cdd4c4bd07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.181176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890b2e3-bd3b-46c7-8d12-d8cdd4c4bd07 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.181531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890b2e3-bd3b-46c7-8d12-d8cdd4c4bd07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.181885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890b2e3-bd3b-46c7-8d12-d8cdd4c4bd07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.194207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295e903-48cd-4bfb-91d1-fe9293171161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df0f4782b1e410b8f4b8810c880b9f6, user_id=12475b431fc849cca75f22db1dd1ffcd, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.197522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295e903-48cd-4bfb-91d1-fe9293171161 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.197740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890b2e3-bd3b-46c7-8d12-d8cdd4c4bd07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.200027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890b2e3-bd3b-46c7-8d12-d8cdd4c4bd07 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.213085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1018/2026] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:36.214664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1009/2027] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:36 2022] PUT /identity/v3/projects/3df0f4782b1e410b8f4b8810c880b9f6/users/12475b431fc849cca75f22db1dd1ffcd/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:36.226072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec28ac-7062-4f45-bbb3-01c02ac82069 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.226366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec28ac-7062-4f45-bbb3-01c02ac82069 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.226992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec28ac-7062-4f45-bbb3-01c02ac82069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.257867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f9ec28ac-7062-4f45-bbb3-01c02ac82069 None None] MFA Rules not processed for user `12475b431fc849cca75f22db1dd1ffcd`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:36.258969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f9ec28ac-7062-4f45-bbb3-01c02ac82069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:36.337264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1019/2028] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:36.342124 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295e903-48cd-4bfb-91d1-fe9293171161 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.407308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295e903-48cd-4bfb-91d1-fe9293171161 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.412775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48fed-a5cb-4eed-9cb3-4fe9a34da780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.413500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48fed-a5cb-4eed-9cb3-4fe9a34da780 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.413856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48fed-a5cb-4eed-9cb3-4fe9a34da780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.414077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48fed-a5cb-4eed-9cb3-4fe9a34da780 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.414866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f48fed-a5cb-4eed-9cb3-4fe9a34da780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.417128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f48fed-a5cb-4eed-9cb3-4fe9a34da780 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.432058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec28ac-7062-4f45-bbb3-01c02ac82069 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.446326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1010/2029] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:36 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:36.446518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec28ac-7062-4f45-bbb3-01c02ac82069 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.447311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48fed-a5cb-4eed-9cb3-4fe9a34da780 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.501928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.502798 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.503078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.503891 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] PATH_INFO: `/v3/users/98edec8ed72746169a45a5cfaaafd247` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.505142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98edec8ed72746169a45a5cfaaafd247)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.507061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.508665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48fed-a5cb-4eed-9cb3-4fe9a34da780 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.513319 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909350ba-8461-40d0-b6cc-3311a03de788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.513977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909350ba-8461-40d0-b6cc-3311a03de788 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.514257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909350ba-8461-40d0-b6cc-3311a03de788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.514529 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909350ba-8461-40d0-b6cc-3311a03de788 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.515220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909350ba-8461-40d0-b6cc-3311a03de788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.517430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909350ba-8461-40d0-b6cc-3311a03de788 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.539940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1011/2030] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:36 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:36.544075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909350ba-8461-40d0-b6cc-3311a03de788 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.555458 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98edec8ed72746169a45a5cfaaafd247'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:36.559062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909350ba-8461-40d0-b6cc-3311a03de788 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.563271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98edec8ed72746169a45a5cfaaafd247'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:36.564866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de2db3-b2ce-41f4-a64e-53352dcf4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.565779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de2db3-b2ce-41f4-a64e-53352dcf4979 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.566696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de2db3-b2ce-41f4-a64e-53352dcf4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.567054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de2db3-b2ce-41f4-a64e-53352dcf4979 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.567905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de2db3-b2ce-41f4-a64e-53352dcf4979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.569636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de2db3-b2ce-41f4-a64e-53352dcf4979 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.573667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98edec8ed72746169a45a5cfaaafd247'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:36.580871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1012/2031] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:36.585771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de2db3-b2ce-41f4-a64e-53352dcf4979 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.589532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98edec8ed72746169a45a5cfaaafd247'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:36.590299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-0944c15d-8a9e-4c44-b84a-f5e35426af7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98edec8ed72746169a45a5cfaaafd247'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:36.598324 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de2db3-b2ce-41f4-a64e-53352dcf4979 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.601527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1020/2032] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:36 2022] DELETE /identity/v3/users/98edec8ed72746169a45a5cfaaafd247 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:36.603846 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac6a0-8315-44ce-a8d1-900be1238b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.605136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac6a0-8315-44ce-a8d1-900be1238b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.605421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac6a0-8315-44ce-a8d1-900be1238b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.605694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac6a0-8315-44ce-a8d1-900be1238b85 admin admin] PATH_INFO: `/v3/projects/78b505e50a0741bb979f2a8472c9258f/users/88a7aae00cb24687aae8780b909ff24b/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.605808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce4f3-8ae1-4d7f-b072-5d301f0a72f6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.606001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce4f3-8ae1-4d7f-b072-5d301f0a72f6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.606283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ce4f3-8ae1-4d7f-b072-5d301f0a72f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.622851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cac6a0-8315-44ce-a8d1-900be1238b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b505e50a0741bb979f2a8472c9258f, user_id=88a7aae00cb24687aae8780b909ff24b, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.625612 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cac6a0-8315-44ce-a8d1-900be1238b85 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.630697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ce8ce4f3-8ae1-4d7f-b072-5d301f0a72f6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:36.632289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ce8ce4f3-8ae1-4d7f-b072-5d301f0a72f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:36.639530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1013/2033] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:36 2022] PUT /identity/v3/projects/78b505e50a0741bb979f2a8472c9258f/users/88a7aae00cb24687aae8780b909ff24b/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:36.643553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac6a0-8315-44ce-a8d1-900be1238b85 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.645820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a0cac6a0-8315-44ce-a8d1-900be1238b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:36.703237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1021/2034] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:36.714496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ce4f3-8ae1-4d7f-b072-5d301f0a72f6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.716096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ce8ce4f3-8ae1-4d7f-b072-5d301f0a72f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:36.717379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac6a0-8315-44ce-a8d1-900be1238b85 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.722835 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260634a-9f4b-4660-97f8-ba916e8cf795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.724318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260634a-9f4b-4660-97f8-ba916e8cf795 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.724611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260634a-9f4b-4660-97f8-ba916e8cf795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.725105 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260634a-9f4b-4660-97f8-ba916e8cf795 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.726043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260634a-9f4b-4660-97f8-ba916e8cf795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.727848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260634a-9f4b-4660-97f8-ba916e8cf795 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.739336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1014/2035] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:36.743877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260634a-9f4b-4660-97f8-ba916e8cf795 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.756474 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260634a-9f4b-4660-97f8-ba916e8cf795 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.764380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850e77-5ead-433f-8e28-b8760552b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.765409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850e77-5ead-433f-8e28-b8760552b918 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.765685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850e77-5ead-433f-8e28-b8760552b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.765958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850e77-5ead-433f-8e28-b8760552b918 admin admin] PATH_INFO: `/v3/projects/78b505e50a0741bb979f2a8472c9258f/users/88a7aae00cb24687aae8780b909ff24b/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.767948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32850e77-5ead-433f-8e28-b8760552b918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b505e50a0741bb979f2a8472c9258f, user_id=88a7aae00cb24687aae8780b909ff24b, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.772219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32850e77-5ead-433f-8e28-b8760552b918 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.783214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1015/2036] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:36 2022] PUT /identity/v3/projects/78b505e50a0741bb979f2a8472c9258f/users/88a7aae00cb24687aae8780b909ff24b/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:36.784861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ce4f3-8ae1-4d7f-b072-5d301f0a72f6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.795090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d54b-9263-4ced-ba5a-45ce00da93ff None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.795375 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d54b-9263-4ced-ba5a-45ce00da93ff None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.795808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d54b-9263-4ced-ba5a-45ce00da93ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.822189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b436d54b-9263-4ced-ba5a-45ce00da93ff None None] MFA Rules not processed for user `88a7aae00cb24687aae8780b909ff24b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:36.823643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b436d54b-9263-4ced-ba5a-45ce00da93ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:36.839564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59619f0d-4720-4922-86aa-96fcc75ea505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.840124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59619f0d-4720-4922-86aa-96fcc75ea505 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.840428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59619f0d-4720-4922-86aa-96fcc75ea505 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.840704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59619f0d-4720-4922-86aa-96fcc75ea505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.898838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1016/2037] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:36.906301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59619f0d-4720-4922-86aa-96fcc75ea505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.907745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59619f0d-4720-4922-86aa-96fcc75ea505 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.908564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d54b-9263-4ced-ba5a-45ce00da93ff None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:36.909935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b436d54b-9263-4ced-ba5a-45ce00da93ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:36.917403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1022/2038] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:36.970470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d54b-9263-4ced-ba5a-45ce00da93ff None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:36.974667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c3f8-7734-4c7b-ac26-efe1e06f7ae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:36.975306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c3f8-7734-4c7b-ac26-efe1e06f7ae4 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:36.975584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c3f8-7734-4c7b-ac26-efe1e06f7ae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:36.975864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65c3f8-7734-4c7b-ac26-efe1e06f7ae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:36.985877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65c3f8-7734-4c7b-ac26-efe1e06f7ae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:36.987315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65c3f8-7734-4c7b-ac26-efe1e06f7ae4 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:36.998503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1017/2039] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:37.469858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59619f0d-4720-4922-86aa-96fcc75ea505 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:37.481970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59619f0d-4720-4922-86aa-96fcc75ea505 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:37.487461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:37.489042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:37.489393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:37.489896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] PATH_INFO: `/v3/users/12475b431fc849cca75f22db1dd1ffcd` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:37.491333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] RBAC: Authorizing `identity:delete_user(user_id=12475b431fc849cca75f22db1dd1ffcd)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:37.493473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:37.517561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c3f8-7734-4c7b-ac26-efe1e06f7ae4 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:37.519196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1c65c3f8-7734-4c7b-ac26-efe1e06f7ae4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:37.538025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65c3f8-7734-4c7b-ac26-efe1e06f7ae4 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:37.543150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:37.544013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:37.544294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:37.544623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] PATH_INFO: `/v3/projects/55e0d7dfde424042b59a69788e8db645` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:37.545869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e0d7dfde424042b59a69788e8db645)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:37.547889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:37.551002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12475b431fc849cca75f22db1dd1ffcd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.558382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12475b431fc849cca75f22db1dd1ffcd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.565366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12475b431fc849cca75f22db1dd1ffcd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.578250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12475b431fc849cca75f22db1dd1ffcd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.579345 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d2ffb8f2-b5dc-41f6-bedb-86ace4bf931d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12475b431fc849cca75f22db1dd1ffcd'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.585788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1023/2040] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:37 2022] DELETE /identity/v3/users/12475b431fc849cca75f22db1dd1ffcd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:37.590172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08bfc5-9447-4b35-837c-3fb7c363ec95 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:37.590486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08bfc5-9447-4b35-837c-3fb7c363ec95 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:37.590766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08bfc5-9447-4b35-837c-3fb7c363ec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:37.600175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e0d7dfde424042b59a69788e8db645', 'request_id': 'req-2cec3332-097e-40b5-810d-4fc0f84b8d09'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.606744 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e0d7dfde424042b59a69788e8db645', 'request_id': 'req-2cec3332-097e-40b5-810d-4fc0f84b8d09'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.608337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ab08bfc5-9447-4b35-837c-3fb7c363ec95 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:37.609566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ab08bfc5-9447-4b35-837c-3fb7c363ec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:37.612560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e0d7dfde424042b59a69788e8db645', 'request_id': 'req-2cec3332-097e-40b5-810d-4fc0f84b8d09'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.625188 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] The token cache is being invalidate because project 55e0d7dfde424042b59a69788e8db645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:37.625378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.626079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.627713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1018/2041] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:37 2022] DELETE /identity/v3/projects/55e0d7dfde424042b59a69788e8db645 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:37.631797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:37.633263 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:37.682239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1024/2042] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:37.695872 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08bfc5-9447-4b35-837c-3fb7c363ec95 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:37.697517 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ab08bfc5-9447-4b35-837c-3fb7c363ec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:37.714556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec3332-097e-40b5-810d-4fc0f84b8d09 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:37.719494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:37.720508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:37.720859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:37.721140 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] PATH_INFO: `/v3/users/b8b414ebe8d444dfb3e65c17e5f3e062` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:37.722937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b414ebe8d444dfb3e65c17e5f3e062)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:37.724928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:37.759793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08bfc5-9447-4b35-837c-3fb7c363ec95 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:37.763712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2416d11-e213-437e-9b54-b9dbdebb14a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:37.764388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2416d11-e213-437e-9b54-b9dbdebb14a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:37.764675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2416d11-e213-437e-9b54-b9dbdebb14a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:37.764947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2416d11-e213-437e-9b54-b9dbdebb14a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:37.771322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b414ebe8d444dfb3e65c17e5f3e062'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.774795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2416d11-e213-437e-9b54-b9dbdebb14a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:37.776328 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2416d11-e213-437e-9b54-b9dbdebb14a5 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:37.778129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b414ebe8d444dfb3e65c17e5f3e062'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.786637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1025/2043] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:37.789899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b414ebe8d444dfb3e65c17e5f3e062'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.790590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b414ebe8d444dfb3e65c17e5f3e062'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.798253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b414ebe8d444dfb3e65c17e5f3e062'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:37.804582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1019/2044] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:37 2022] DELETE /identity/v3/users/b8b414ebe8d444dfb3e65c17e5f3e062 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:38.060810 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2416d11-e213-437e-9b54-b9dbdebb14a5 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.062479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e2416d11-e213-437e-9b54-b9dbdebb14a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:38.087425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2416d11-e213-437e-9b54-b9dbdebb14a5 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.100733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.103791 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:38.167241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.168417 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.168748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.169026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] PATH_INFO: `/v3/projects/3df0f4782b1e410b8f4b8810c880b9f6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.170251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df0f4782b1e410b8f4b8810c880b9f6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.172218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:38.181641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6da0b-bf54-49c1-8bef-53f7e6fc87f4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.186205 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.187054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.187337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.187613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] PATH_INFO: `/v3/projects/0593e084f1d346878c8ce511a1757421` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.188881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0593e084f1d346878c8ce511a1757421)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.191308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:38.217677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df0f4782b1e410b8f4b8810c880b9f6', 'request_id': 'req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.224056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df0f4782b1e410b8f4b8810c880b9f6', 'request_id': 'req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.230809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df0f4782b1e410b8f4b8810c880b9f6', 'request_id': 'req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.237125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0593e084f1d346878c8ce511a1757421', 'request_id': 'req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.241545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] The token cache is being invalidate because project 3df0f4782b1e410b8f4b8810c880b9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:38.241871 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.242504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.243402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0593e084f1d346878c8ce511a1757421', 'request_id': 'req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.244229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1026/2045] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:38 2022] DELETE /identity/v3/projects/3df0f4782b1e410b8f4b8810c880b9f6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:38.248438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.249261 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0593e084f1d346878c8ce511a1757421', 'request_id': 'req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.249899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:38.262467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] The token cache is being invalidate because project 0593e084f1d346878c8ce511a1757421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:38.262925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.263577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-209b72a4-2a5e-4dda-86c9-4fc1116beb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.265198 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1020/2046] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:38 2022] DELETE /identity/v3/projects/0593e084f1d346878c8ce511a1757421 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:38.273334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a1bde-3cad-4e06-a308-f1f0248f767c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.273618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a1bde-3cad-4e06-a308-f1f0248f767c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.273973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a1bde-3cad-4e06-a308-f1f0248f767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.291844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-540a1bde-3cad-4e06-a308-f1f0248f767c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:38.293060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-540a1bde-3cad-4e06-a308-f1f0248f767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:38.312317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf3e23-d9e0-4c04-815e-a64c1cf54453 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.354937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1021/2047] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:38.363432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae499d00-d2ba-4825-bfad-37f23962e087 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.363785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae499d00-d2ba-4825-bfad-37f23962e087 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.364148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae499d00-d2ba-4825-bfad-37f23962e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.379083 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.379965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.380240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.380549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] PATH_INFO: `/v3/users/88a7aae00cb24687aae8780b909ff24b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.381816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a7aae00cb24687aae8780b909ff24b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.383892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:38.385056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ae499d00-d2ba-4825-bfad-37f23962e087 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:38.386300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ae499d00-d2ba-4825-bfad-37f23962e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:38.396578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1022/2048] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:38.400555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae499d00-d2ba-4825-bfad-37f23962e087 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.410189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae499d00-d2ba-4825-bfad-37f23962e087 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.415147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f433-1525-4bff-a450-2353cf881cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.415797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f433-1525-4bff-a450-2353cf881cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.416079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f433-1525-4bff-a450-2353cf881cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.416371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f433-1525-4bff-a450-2353cf881cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.417127 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6f433-1525-4bff-a450-2353cf881cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:38.417445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6f433-1525-4bff-a450-2353cf881cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.419078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6f433-1525-4bff-a450-2353cf881cf9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:38.432441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1023/2049] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:41:38.438572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f433-1525-4bff-a450-2353cf881cf9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.449999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a7aae00cb24687aae8780b909ff24b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.459672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a7aae00cb24687aae8780b909ff24b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.461010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f433-1525-4bff-a450-2353cf881cf9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.466051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b17f-cd14-4433-9ef4-e5314dca25cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.466768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b17f-cd14-4433-9ef4-e5314dca25cf admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.467058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b17f-cd14-4433-9ef4-e5314dca25cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.467346 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57b17f-cd14-4433-9ef4-e5314dca25cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.467856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a7aae00cb24687aae8780b909ff24b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.468049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b17f-cd14-4433-9ef4-e5314dca25cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.470471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57b17f-cd14-4433-9ef4-e5314dca25cf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:38.480631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a7aae00cb24687aae8780b909ff24b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.481386 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a7aae00cb24687aae8780b909ff24b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:38.488248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1027/2050] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:38 2022] DELETE /identity/v3/users/88a7aae00cb24687aae8780b909ff24b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:38.504980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1024/2051] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:38 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:38.509280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.510704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:38.603971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d48e55-49dd-494c-99de-5d44ff6a8b6e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.684322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7abf71-d3ed-4a56-ac16-f33218f4d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.685273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7abf71-d3ed-4a56-ac16-f33218f4d9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.686083 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7abf71-d3ed-4a56-ac16-f33218f4d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.686744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7abf71-d3ed-4a56-ac16-f33218f4d9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.688065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7abf71-d3ed-4a56-ac16-f33218f4d9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.690372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7abf71-d3ed-4a56-ac16-f33218f4d9e5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:38.718320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1028/2052] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:38 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:38.722860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b17f-cd14-4433-9ef4-e5314dca25cf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.734363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57b17f-cd14-4433-9ef4-e5314dca25cf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.739985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31585e6-32f9-434f-b184-953e13df39f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.740785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31585e6-32f9-434f-b184-953e13df39f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.741178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31585e6-32f9-434f-b184-953e13df39f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.741552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31585e6-32f9-434f-b184-953e13df39f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.742492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31585e6-32f9-434f-b184-953e13df39f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.744402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31585e6-32f9-434f-b184-953e13df39f4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:38.758661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1025/2053] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:38.759667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7abf71-d3ed-4a56-ac16-f33218f4d9e5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.771359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7abf71-d3ed-4a56-ac16-f33218f4d9e5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.776212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256f96b-d394-4b13-8a13-aacfade65ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.776912 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256f96b-d394-4b13-8a13-aacfade65ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.777195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256f96b-d394-4b13-8a13-aacfade65ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.777618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256f96b-d394-4b13-8a13-aacfade65ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.778204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256f96b-d394-4b13-8a13-aacfade65ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.779796 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256f96b-d394-4b13-8a13-aacfade65ad9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:38.791264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1029/2054] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:38.796870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31585e6-32f9-434f-b184-953e13df39f4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.809900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31585e6-32f9-434f-b184-953e13df39f4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.822311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534299e4-ce8a-426f-9d6c-eb4bf70822c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.823714 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534299e4-ce8a-426f-9d6c-eb4bf70822c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.824206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534299e4-ce8a-426f-9d6c-eb4bf70822c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.825155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534299e4-ce8a-426f-9d6c-eb4bf70822c6 admin admin] PATH_INFO: `/v3/projects/d9f9720d47bf436e9e2262ac2dcc2edd/users/7eca8d13e876404ca76657f752ce2293/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.845354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534299e4-ce8a-426f-9d6c-eb4bf70822c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f9720d47bf436e9e2262ac2dcc2edd, user_id=7eca8d13e876404ca76657f752ce2293, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.850159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534299e4-ce8a-426f-9d6c-eb4bf70822c6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:38.871932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1026/2055] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:38 2022] PUT /identity/v3/projects/d9f9720d47bf436e9e2262ac2dcc2edd/users/7eca8d13e876404ca76657f752ce2293/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:38.883119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eaf01-a064-4e0f-ad71-755fec3917d5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.883415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eaf01-a064-4e0f-ad71-755fec3917d5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.883695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2eaf01-a064-4e0f-ad71-755fec3917d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.911195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534299e4-ce8a-426f-9d6c-eb4bf70822c6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:38.913187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-534299e4-ce8a-426f-9d6c-eb4bf70822c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:38.934728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1a2eaf01-a064-4e0f-ad71-755fec3917d5 None None] MFA Rules not processed for user `7eca8d13e876404ca76657f752ce2293`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:38.936142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1a2eaf01-a064-4e0f-ad71-755fec3917d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:38.989272 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534299e4-ce8a-426f-9d6c-eb4bf70822c6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:38.993932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:38.994781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:38.995060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:38.995340 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] PATH_INFO: `/v3/projects/78b505e50a0741bb979f2a8472c9258f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:38.996576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b505e50a0741bb979f2a8472c9258f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:38.998471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.004012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1030/2056] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:39.008496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eaf01-a064-4e0f-ad71-755fec3917d5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.018496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2eaf01-a064-4e0f-ad71-755fec3917d5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.023173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e0f2-915c-4a5d-a247-a300896579d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.023828 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e0f2-915c-4a5d-a247-a300896579d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.024106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e0f2-915c-4a5d-a247-a300896579d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.024398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e0f2-915c-4a5d-a247-a300896579d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.025097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677e0f2-915c-4a5d-a247-a300896579d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.027099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677e0f2-915c-4a5d-a247-a300896579d7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.046722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b505e50a0741bb979f2a8472c9258f', 'request_id': 'req-54769e5b-06d5-4770-b966-690c00c18a0a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.053799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1031/2057] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:39 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:39.053957 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b505e50a0741bb979f2a8472c9258f', 'request_id': 'req-54769e5b-06d5-4770-b966-690c00c18a0a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.057659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e0f2-915c-4a5d-a247-a300896579d7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.059920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b505e50a0741bb979f2a8472c9258f', 'request_id': 'req-54769e5b-06d5-4770-b966-690c00c18a0a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.073814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] The token cache is being invalidate because project 78b505e50a0741bb979f2a8472c9258f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:39.074099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.074743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-54769e5b-06d5-4770-b966-690c00c18a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.076308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1027/2058] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:38 2022] DELETE /identity/v3/projects/78b505e50a0741bb979f2a8472c9258f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:39.082680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d81c0b-2be9-47e6-ab2a-1225896db775 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.082680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d81c0b-2be9-47e6-ab2a-1225896db775 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.083335 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d81c0b-2be9-47e6-ab2a-1225896db775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.101909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d1d81c0b-2be9-47e6-ab2a-1225896db775 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:39.103288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d1d81c0b-2be9-47e6-ab2a-1225896db775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:39.120778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e0f2-915c-4a5d-a247-a300896579d7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.127194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba7f4-8015-47d2-b27d-6054dbc384cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.127857 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba7f4-8015-47d2-b27d-6054dbc384cf admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.128140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba7f4-8015-47d2-b27d-6054dbc384cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.129017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba7f4-8015-47d2-b27d-6054dbc384cf admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.129724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ba7f4-8015-47d2-b27d-6054dbc384cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.131660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ba7f4-8015-47d2-b27d-6054dbc384cf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.151704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1032/2059] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:39 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:39.155643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba7f4-8015-47d2-b27d-6054dbc384cf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.157464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3c7ba7f4-8015-47d2-b27d-6054dbc384cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:39.163909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1028/2060] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:39.169249 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba7f4-8015-47d2-b27d-6054dbc384cf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.171613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb20932-97af-4a8a-9c46-7843652fbc74 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.171900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb20932-97af-4a8a-9c46-7843652fbc74 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.172178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb20932-97af-4a8a-9c46-7843652fbc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.174051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a357f-87ab-40ae-b697-ba8679050664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.174730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a357f-87ab-40ae-b697-ba8679050664 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.175009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a357f-87ab-40ae-b697-ba8679050664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.175863 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a357f-87ab-40ae-b697-ba8679050664 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.176638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a357f-87ab-40ae-b697-ba8679050664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.178232 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20a357f-87ab-40ae-b697-ba8679050664 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.191664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1033/2061] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:39.191845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0eb20932-97af-4a8a-9c46-7843652fbc74 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:39.191963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0eb20932-97af-4a8a-9c46-7843652fbc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:39.192605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a357f-87ab-40ae-b697-ba8679050664 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.200185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1029/2062] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:39.205164 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a357f-87ab-40ae-b697-ba8679050664 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.205323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb20932-97af-4a8a-9c46-7843652fbc74 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.209882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0ae88-c0cd-4f9b-8671-e352b485cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.210743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0ae88-c0cd-4f9b-8671-e352b485cfbc admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.211023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0ae88-c0cd-4f9b-8671-e352b485cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.211294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0ae88-c0cd-4f9b-8671-e352b485cfbc admin admin] PATH_INFO: `/v3/projects/90bd8703c5274fd6812421d491c7f8fb/users/2f1ee2a7da2649ceacf50d80bf57d69c/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.214291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb20932-97af-4a8a-9c46-7843652fbc74 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.218835 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de0bbd-33ab-4303-9123-6b9b2d3e82f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.219463 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de0bbd-33ab-4303-9123-6b9b2d3e82f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.219734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de0bbd-33ab-4303-9123-6b9b2d3e82f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.220004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de0bbd-33ab-4303-9123-6b9b2d3e82f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.220753 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de0bbd-33ab-4303-9123-6b9b2d3e82f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:39.221055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de0bbd-33ab-4303-9123-6b9b2d3e82f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.222654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de0bbd-33ab-4303-9123-6b9b2d3e82f9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.226701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0ae88-c0cd-4f9b-8671-e352b485cfbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bd8703c5274fd6812421d491c7f8fb, user_id=2f1ee2a7da2649ceacf50d80bf57d69c, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.229354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0ae88-c0cd-4f9b-8671-e352b485cfbc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.234083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1030/2063] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:41:39.239455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de0bbd-33ab-4303-9123-6b9b2d3e82f9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.246985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1034/2064] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:39 2022] PUT /identity/v3/projects/90bd8703c5274fd6812421d491c7f8fb/users/2f1ee2a7da2649ceacf50d80bf57d69c/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:39.251278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0ae88-c0cd-4f9b-8671-e352b485cfbc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.257964 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de0bbd-33ab-4303-9123-6b9b2d3e82f9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.311436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5169c7b-844f-4915-a7b5-ea32aa8c878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.311647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0ae88-c0cd-4f9b-8671-e352b485cfbc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.312088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5169c7b-844f-4915-a7b5-ea32aa8c878e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.312394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5169c7b-844f-4915-a7b5-ea32aa8c878e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.312669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5169c7b-844f-4915-a7b5-ea32aa8c878e admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.313365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5169c7b-844f-4915-a7b5-ea32aa8c878e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.315238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5169c7b-844f-4915-a7b5-ea32aa8c878e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.316944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e90653-cc5c-4e17-b67a-84ce3386e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.317637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e90653-cc5c-4e17-b67a-84ce3386e8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.317919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e90653-cc5c-4e17-b67a-84ce3386e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.318193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e90653-cc5c-4e17-b67a-84ce3386e8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.318927 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e90653-cc5c-4e17-b67a-84ce3386e8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.320541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e90653-cc5c-4e17-b67a-84ce3386e8a0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.330871 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1035/2065] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:39.335271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e90653-cc5c-4e17-b67a-84ce3386e8a0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.342812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1031/2066] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:39 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:39.344701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e90653-cc5c-4e17-b67a-84ce3386e8a0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.347059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5169c7b-844f-4915-a7b5-ea32aa8c878e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.401526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf30f5-e8f8-4ed0-a057-461fa3a16239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.402472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf30f5-e8f8-4ed0-a057-461fa3a16239 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.402688 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf30f5-e8f8-4ed0-a057-461fa3a16239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.402963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf30f5-e8f8-4ed0-a057-461fa3a16239 admin admin] PATH_INFO: `/v3/projects/90bd8703c5274fd6812421d491c7f8fb/users/2f1ee2a7da2649ceacf50d80bf57d69c/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.405196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf30f5-e8f8-4ed0-a057-461fa3a16239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bd8703c5274fd6812421d491c7f8fb, user_id=2f1ee2a7da2649ceacf50d80bf57d69c, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.407186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5169c7b-844f-4915-a7b5-ea32aa8c878e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.408040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf30f5-e8f8-4ed0-a057-461fa3a16239 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.413932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46fd7-1ab4-4c31-bf92-a2be4b01b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.414727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46fd7-1ab4-4c31-bf92-a2be4b01b519 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.415113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46fd7-1ab4-4c31-bf92-a2be4b01b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.415393 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46fd7-1ab4-4c31-bf92-a2be4b01b519 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.416097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d46fd7-1ab4-4c31-bf92-a2be4b01b519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.418033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d46fd7-1ab4-4c31-bf92-a2be4b01b519 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.419316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1036/2067] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:39 2022] PUT /identity/v3/projects/90bd8703c5274fd6812421d491c7f8fb/users/2f1ee2a7da2649ceacf50d80bf57d69c/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:39.430700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14cc41-b8d8-422a-80bd-920174982380 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.431166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14cc41-b8d8-422a-80bd-920174982380 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.431513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14cc41-b8d8-422a-80bd-920174982380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.445797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1032/2068] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:39 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:39.450778 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46fd7-1ab4-4c31-bf92-a2be4b01b519 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.462625 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fe14cc41-b8d8-422a-80bd-920174982380 None None] MFA Rules not processed for user `2f1ee2a7da2649ceacf50d80bf57d69c`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:39.463368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46fd7-1ab4-4c31-bf92-a2be4b01b519 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.463883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fe14cc41-b8d8-422a-80bd-920174982380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:39.518439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be30c2d-013b-4d21-91a9-f2b784143f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.519121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be30c2d-013b-4d21-91a9-f2b784143f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.519396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be30c2d-013b-4d21-91a9-f2b784143f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.519664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be30c2d-013b-4d21-91a9-f2b784143f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.520420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be30c2d-013b-4d21-91a9-f2b784143f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.522009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be30c2d-013b-4d21-91a9-f2b784143f4a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.531491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1033/2069] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:39.535777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be30c2d-013b-4d21-91a9-f2b784143f4a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.539143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1037/2070] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:39.545198 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be30c2d-013b-4d21-91a9-f2b784143f4a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.548757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14cc41-b8d8-422a-80bd-920174982380 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.549861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe9ebb-6e90-45a9-9656-77eef177512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.550061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fe14cc41-b8d8-422a-80bd-920174982380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:39.551085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe9ebb-6e90-45a9-9656-77eef177512b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.551366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe9ebb-6e90-45a9-9656-77eef177512b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.551640 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe9ebb-6e90-45a9-9656-77eef177512b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.552390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe9ebb-6e90-45a9-9656-77eef177512b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.553959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe9ebb-6e90-45a9-9656-77eef177512b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.563962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1034/2071] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:39.567911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe9ebb-6e90-45a9-9656-77eef177512b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.577633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe9ebb-6e90-45a9-9656-77eef177512b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.582270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfb332-5795-48e7-aa25-cefae6435d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.583174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfb332-5795-48e7-aa25-cefae6435d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.583525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfb332-5795-48e7-aa25-cefae6435d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.583799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfb332-5795-48e7-aa25-cefae6435d8e admin admin] PATH_INFO: `/v3/projects/07b2b3041b5c44529941e9bc77001811/users/ef47243cfa2d4a8a996f85ed39dc24d0/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.598342 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfb332-5795-48e7-aa25-cefae6435d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b2b3041b5c44529941e9bc77001811, user_id=ef47243cfa2d4a8a996f85ed39dc24d0, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.600972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfb332-5795-48e7-aa25-cefae6435d8e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.604916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14cc41-b8d8-422a-80bd-920174982380 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.608903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c746368-938f-48bb-9245-8d769ee9e926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.609530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c746368-938f-48bb-9245-8d769ee9e926 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.609807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c746368-938f-48bb-9245-8d769ee9e926 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.610076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c746368-938f-48bb-9245-8d769ee9e926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.615620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1035/2072] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:39 2022] PUT /identity/v3/projects/07b2b3041b5c44529941e9bc77001811/users/ef47243cfa2d4a8a996f85ed39dc24d0/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:39.620848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c746368-938f-48bb-9245-8d769ee9e926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.622299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c746368-938f-48bb-9245-8d769ee9e926 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.629842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc84f2c-6f27-44a3-b270-9c4cf503bba4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.629842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc84f2c-6f27-44a3-b270-9c4cf503bba4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.629842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc84f2c-6f27-44a3-b270-9c4cf503bba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.640196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1038/2073] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:39.657646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3fc84f2c-6f27-44a3-b270-9c4cf503bba4 None None] MFA Rules not processed for user `ef47243cfa2d4a8a996f85ed39dc24d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:39.658800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3fc84f2c-6f27-44a3-b270-9c4cf503bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:39.670391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c746368-938f-48bb-9245-8d769ee9e926 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.686732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c746368-938f-48bb-9245-8d769ee9e926 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.728559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1036/2074] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:39.734960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc84f2c-6f27-44a3-b270-9c4cf503bba4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.746582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.747473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.747826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.748163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] PATH_INFO: `/v3/users/7eca8d13e876404ca76657f752ce2293` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.749703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eca8d13e876404ca76657f752ce2293)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.752775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.796083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc84f2c-6f27-44a3-b270-9c4cf503bba4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.800819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd37c1-32a8-4604-9070-bd1be0b5c954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.801608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd37c1-32a8-4604-9070-bd1be0b5c954 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.801887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd37c1-32a8-4604-9070-bd1be0b5c954 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.802289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd37c1-32a8-4604-9070-bd1be0b5c954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.805774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eca8d13e876404ca76657f752ce2293'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.816867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd37c1-32a8-4604-9070-bd1be0b5c954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.818659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd37c1-32a8-4604-9070-bd1be0b5c954 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.821992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eca8d13e876404ca76657f752ce2293'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.830437 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1037/2075] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:39.831209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd37c1-32a8-4604-9070-bd1be0b5c954 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.833455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2abd37c1-32a8-4604-9070-bd1be0b5c954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:39.842620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eca8d13e876404ca76657f752ce2293'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.855896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd37c1-32a8-4604-9070-bd1be0b5c954 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.861988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.862853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eca8d13e876404ca76657f752ce2293'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.862982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.863328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.863665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] PATH_INFO: `/v3/users/6bdc47212731405fbbe0422046440b4c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.863964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eca8d13e876404ca76657f752ce2293'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.867817 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdc47212731405fbbe0422046440b4c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.870923 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.874017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1039/2076] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:39 2022] DELETE /identity/v3/users/7eca8d13e876404ca76657f752ce2293 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:39.876484 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:39.876484 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:39.930353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdc47212731405fbbe0422046440b4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.937796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdc47212731405fbbe0422046440b4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.950288 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04441090-48c9-40a9-b3ed-4c921fd87ce1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:39.950778 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdc47212731405fbbe0422046440b4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.951496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdc47212731405fbbe0422046440b4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.955340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:39.957063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.957387 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.957690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] PATH_INFO: `/v3/users/ef47243cfa2d4a8a996f85ed39dc24d0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.959071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef47243cfa2d4a8a996f85ed39dc24d0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:39.959495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a9f393ff-a892-4073-8797-ebbe4850ce8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdc47212731405fbbe0422046440b4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:39.961295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:39.965794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1038/2077] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:39 2022] DELETE /identity/v3/users/6bdc47212731405fbbe0422046440b4c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:39.966900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d1c4b-65f4-4440-8bfc-b506ef1d3e1e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:39.967186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d1c4b-65f4-4440-8bfc-b506ef1d3e1e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:39.967461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d1c4b-65f4-4440-8bfc-b506ef1d3e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:39.985946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c52d1c4b-65f4-4440-8bfc-b506ef1d3e1e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:39.987147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c52d1c4b-65f4-4440-8bfc-b506ef1d3e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.010022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef47243cfa2d4a8a996f85ed39dc24d0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.020414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef47243cfa2d4a8a996f85ed39dc24d0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.036286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef47243cfa2d4a8a996f85ed39dc24d0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.050764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef47243cfa2d4a8a996f85ed39dc24d0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.051748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-78263a45-79f8-4d3c-a9b8-40bb82899847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef47243cfa2d4a8a996f85ed39dc24d0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.056759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1039/2078] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:40.058148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e206-acf4-45b8-aad7-a9e1f7668914 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.058433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e206-acf4-45b8-aad7-a9e1f7668914 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.058580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1040/2079] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:39 2022] DELETE /identity/v3/users/ef47243cfa2d4a8a996f85ed39dc24d0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:40.058709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e206-acf4-45b8-aad7-a9e1f7668914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.064147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918de5f0-166e-44a4-a930-5fb30ea3651f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.064467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918de5f0-166e-44a4-a930-5fb30ea3651f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.064748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918de5f0-166e-44a4-a930-5fb30ea3651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.080874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f2b1e206-acf4-45b8-aad7-a9e1f7668914 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:40.082594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f2b1e206-acf4-45b8-aad7-a9e1f7668914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.082707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-918de5f0-166e-44a4-a930-5fb30ea3651f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:40.083750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-918de5f0-166e-44a4-a930-5fb30ea3651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.140929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1040/2080] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:40.141188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1041/2081] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:40.141969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918de5f0-166e-44a4-a930-5fb30ea3651f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:40.143315 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-918de5f0-166e-44a4-a930-5fb30ea3651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.151204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e206-acf4-45b8-aad7-a9e1f7668914 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:40.152567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f2b1e206-acf4-45b8-aad7-a9e1f7668914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.201696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918de5f0-166e-44a4-a930-5fb30ea3651f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:40.205233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc99a-f8f3-4181-bdc4-87c8c73b2723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:40.205879 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc99a-f8f3-4181-bdc4-87c8c73b2723 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.206142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc99a-f8f3-4181-bdc4-87c8c73b2723 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.206961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc99a-f8f3-4181-bdc4-87c8c73b2723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.208942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e206-acf4-45b8-aad7-a9e1f7668914 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:40.212652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927f15d-3998-450c-a5ad-b0d02d0de1fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:40.213287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927f15d-3998-450c-a5ad-b0d02d0de1fd service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.213566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927f15d-3998-450c-a5ad-b0d02d0de1fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.213839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927f15d-3998-450c-a5ad-b0d02d0de1fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.215927 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbc99a-f8f3-4181-bdc4-87c8c73b2723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:40.217395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbc99a-f8f3-4181-bdc4-87c8c73b2723 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:40.223457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927f15d-3998-450c-a5ad-b0d02d0de1fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:40.224940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927f15d-3998-450c-a5ad-b0d02d0de1fd service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:40.227135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1042/2082] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:40.229215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc99a-f8f3-4181-bdc4-87c8c73b2723 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:40.234803 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1041/2083] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:40.237312 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc99a-f8f3-4181-bdc4-87c8c73b2723 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:40.241062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe514812-f14b-40ca-b2ee-2733d19f690b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:40.241705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe514812-f14b-40ca-b2ee-2733d19f690b service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.241982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe514812-f14b-40ca-b2ee-2733d19f690b service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.242581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe514812-f14b-40ca-b2ee-2733d19f690b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.252286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe514812-f14b-40ca-b2ee-2733d19f690b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:40.254125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe514812-f14b-40ca-b2ee-2733d19f690b service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:40.264381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1043/2084] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:40.578448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927f15d-3998-450c-a5ad-b0d02d0de1fd service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:40.579874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2927f15d-3998-450c-a5ad-b0d02d0de1fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.594131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927f15d-3998-450c-a5ad-b0d02d0de1fd service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:40.599830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:40.600836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.601179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.601538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] PATH_INFO: `/v3/projects/0336eb36243d4523a9eb9fe0b8cc6f39` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.602832 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0336eb36243d4523a9eb9fe0b8cc6f39)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:40.604963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:40.662432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe514812-f14b-40ca-b2ee-2733d19f690b service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:40.663888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fe514812-f14b-40ca-b2ee-2733d19f690b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.669612 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0336eb36243d4523a9eb9fe0b8cc6f39', 'request_id': 'req-f361294e-8b04-4896-a4fa-4dd275be71cb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.682046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe514812-f14b-40ca-b2ee-2733d19f690b service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:40.686326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0336eb36243d4523a9eb9fe0b8cc6f39', 'request_id': 'req-f361294e-8b04-4896-a4fa-4dd275be71cb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.694560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0336eb36243d4523a9eb9fe0b8cc6f39', 'request_id': 'req-f361294e-8b04-4896-a4fa-4dd275be71cb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.715312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] The token cache is being invalidate because project 0336eb36243d4523a9eb9fe0b8cc6f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:40.715608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.716248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.718713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1042/2085] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:40 2022] DELETE /identity/v3/projects/0336eb36243d4523a9eb9fe0b8cc6f39 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:40.719579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:40.720942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.747663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:40.748644 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.748993 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.749352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] PATH_INFO: `/v3/projects/d9f9720d47bf436e9e2262ac2dcc2edd` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.750627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f9720d47bf436e9e2262ac2dcc2edd)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:40.752895 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:40.792295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361294e-8b04-4896-a4fa-4dd275be71cb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:40.806088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f9720d47bf436e9e2262ac2dcc2edd', 'request_id': 'req-b294e069-ff42-4352-a610-cc7ac29955e1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.812162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f9720d47bf436e9e2262ac2dcc2edd', 'request_id': 'req-b294e069-ff42-4352-a610-cc7ac29955e1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.820865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f9720d47bf436e9e2262ac2dcc2edd', 'request_id': 'req-b294e069-ff42-4352-a610-cc7ac29955e1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.831754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] The token cache is being invalidate because project d9f9720d47bf436e9e2262ac2dcc2edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:40.832031 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.832706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.834465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1044/2086] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:40 2022] DELETE /identity/v3/projects/d9f9720d47bf436e9e2262ac2dcc2edd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:40.835020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:40.836367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.855190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:40.856440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.856864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.857299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] PATH_INFO: `/v3/projects/07b2b3041b5c44529941e9bc77001811` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.858516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b2b3041b5c44529941e9bc77001811)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:40.860583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:40.902039 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294e069-ff42-4352-a610-cc7ac29955e1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:40.911860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b2b3041b5c44529941e9bc77001811', 'request_id': 'req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.920945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b2b3041b5c44529941e9bc77001811', 'request_id': 'req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.928068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b2b3041b5c44529941e9bc77001811', 'request_id': 'req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.944959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] The token cache is being invalidate because project 07b2b3041b5c44529941e9bc77001811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:40.945402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.946157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:40.963285 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1043/2087] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:40 2022] DELETE /identity/v3/projects/07b2b3041b5c44529941e9bc77001811 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:40.964983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:40.965880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:40.966939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.967264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.967617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] PATH_INFO: `/v3/users/c4e3d0caa3234e95a0b40174eb81516d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.968960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:40.969067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e3d0caa3234e95a0b40174eb81516d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:40.971168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:40.987469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05c315-2ee9-48ce-b1ee-580656ddc9cb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:40.992997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:40.994302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:40.994651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:40.994994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] PATH_INFO: `/v3/users/2f1ee2a7da2649ceacf50d80bf57d69c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:40.996287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1ee2a7da2649ceacf50d80bf57d69c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:40.998629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.024267 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e3d0caa3234e95a0b40174eb81516d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.032028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e3d0caa3234e95a0b40174eb81516d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.039603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e3d0caa3234e95a0b40174eb81516d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.051494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1ee2a7da2649ceacf50d80bf57d69c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.054577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e3d0caa3234e95a0b40174eb81516d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.055441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1daca134-a931-4c6b-9202-7416c5dfc75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e3d0caa3234e95a0b40174eb81516d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.062344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1045/2088] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:40 2022] DELETE /identity/v3/users/c4e3d0caa3234e95a0b40174eb81516d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:41.063731 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68b351-a435-4fb6-8eb9-8809bd02a95f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.063834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1ee2a7da2649ceacf50d80bf57d69c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.064016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68b351-a435-4fb6-8eb9-8809bd02a95f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.064294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68b351-a435-4fb6-8eb9-8809bd02a95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.080526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1ee2a7da2649ceacf50d80bf57d69c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.081300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1ee2a7da2649ceacf50d80bf57d69c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.083186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ad68b351-a435-4fb6-8eb9-8809bd02a95f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:41.084429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ad68b351-a435-4fb6-8eb9-8809bd02a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.089644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4322f96b-6d3f-40f2-8558-ae1c5a23d421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1ee2a7da2649ceacf50d80bf57d69c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.096506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1044/2089] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:40 2022] DELETE /identity/v3/users/2f1ee2a7da2649ceacf50d80bf57d69c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:41.150168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1046/2090] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:41.158738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e829d5-6c2a-4a32-b36d-f2523f57e5f9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.159024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e829d5-6c2a-4a32-b36d-f2523f57e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.159303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e829d5-6c2a-4a32-b36d-f2523f57e5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.180650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-28e829d5-6c2a-4a32-b36d-f2523f57e5f9 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:41.182102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-28e829d5-6c2a-4a32-b36d-f2523f57e5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.261432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1045/2091] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:41.265496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68b351-a435-4fb6-8eb9-8809bd02a95f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.274995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68b351-a435-4fb6-8eb9-8809bd02a95f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.279636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b658a-a91d-42a7-8c02-bc766db292ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.280295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b658a-a91d-42a7-8c02-bc766db292ae admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.280616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b658a-a91d-42a7-8c02-bc766db292ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.280882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b658a-a91d-42a7-8c02-bc766db292ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.281621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b658a-a91d-42a7-8c02-bc766db292ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:41.281932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b658a-a91d-42a7-8c02-bc766db292ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.283544 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b658a-a91d-42a7-8c02-bc766db292ae admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.295617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1047/2092] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:41:41.301792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e829d5-6c2a-4a32-b36d-f2523f57e5f9 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.312520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e829d5-6c2a-4a32-b36d-f2523f57e5f9 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.318288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5931-1733-4613-888c-cfdbb47401ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.318965 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5931-1733-4613-888c-cfdbb47401ff admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.319280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5931-1733-4613-888c-cfdbb47401ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.319520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d5931-1733-4613-888c-cfdbb47401ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.320243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d5931-1733-4613-888c-cfdbb47401ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.322307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d5931-1733-4613-888c-cfdbb47401ff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.352763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1046/2093] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:41.353957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b658a-a91d-42a7-8c02-bc766db292ae admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.364075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b658a-a91d-42a7-8c02-bc766db292ae admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.425407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093fbc6-46d1-41fa-9687-10c4244f0155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.426483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093fbc6-46d1-41fa-9687-10c4244f0155 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.426595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093fbc6-46d1-41fa-9687-10c4244f0155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.426945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093fbc6-46d1-41fa-9687-10c4244f0155 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.427658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093fbc6-46d1-41fa-9687-10c4244f0155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.432310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093fbc6-46d1-41fa-9687-10c4244f0155 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.433647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5931-1733-4613-888c-cfdbb47401ff admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.435802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a88d5931-1733-4613-888c-cfdbb47401ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.450941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d5931-1733-4613-888c-cfdbb47401ff admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.459866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.461064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.461418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.461769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] PATH_INFO: `/v3/projects/72cb7e32c4cf436398066384703dff17` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.463133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72cb7e32c4cf436398066384703dff17)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.465307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.476955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1048/2094] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:41.477807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093fbc6-46d1-41fa-9687-10c4244f0155 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.479427 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2093fbc6-46d1-41fa-9687-10c4244f0155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.493917 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093fbc6-46d1-41fa-9687-10c4244f0155 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.499356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.500190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.500521 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.501008 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] PATH_INFO: `/v3/projects/90bd8703c5274fd6812421d491c7f8fb` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.502642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bd8703c5274fd6812421d491c7f8fb)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.504759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.532445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72cb7e32c4cf436398066384703dff17', 'request_id': 'req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.543462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72cb7e32c4cf436398066384703dff17', 'request_id': 'req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.550825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72cb7e32c4cf436398066384703dff17', 'request_id': 'req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.563850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] The token cache is being invalidate because project 72cb7e32c4cf436398066384703dff17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:41.564134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.564574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bd8703c5274fd6812421d491c7f8fb', 'request_id': 'req-82e13c97-b598-4132-a650-ef06202289ad'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.564779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.566365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1047/2095] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:41 2022] DELETE /identity/v3/projects/72cb7e32c4cf436398066384703dff17 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:41.567112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.568367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.576830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bd8703c5274fd6812421d491c7f8fb', 'request_id': 'req-82e13c97-b598-4132-a650-ef06202289ad'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.584956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bd8703c5274fd6812421d491c7f8fb', 'request_id': 'req-82e13c97-b598-4132-a650-ef06202289ad'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.595178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] The token cache is being invalidate because project 90bd8703c5274fd6812421d491c7f8fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:41.595464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.596109 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-82e13c97-b598-4132-a650-ef06202289ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:41.598309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1049/2096] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:41 2022] DELETE /identity/v3/projects/90bd8703c5274fd6812421d491c7f8fb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:41.599523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f685927-c141-4b57-a57c-715ffa444904 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.599804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f685927-c141-4b57-a57c-715ffa444904 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.600076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f685927-c141-4b57-a57c-715ffa444904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.617340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8f685927-c141-4b57-a57c-715ffa444904 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:41.618537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8f685927-c141-4b57-a57c-715ffa444904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.636646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41e543-3a3f-429a-ba43-bbcbb58b19c6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.677020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1050/2097] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:41.678935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc754-a85b-4ed6-9ffa-f1ef22aef89b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.679354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc754-a85b-4ed6-9ffa-f1ef22aef89b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.679786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdc754-a85b-4ed6-9ffa-f1ef22aef89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.691985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e81cb4-edc2-494f-a7de-2bed877b5184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.692693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e81cb4-edc2-494f-a7de-2bed877b5184 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.692969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e81cb4-edc2-494f-a7de-2bed877b5184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.693249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e81cb4-edc2-494f-a7de-2bed877b5184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.693983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e81cb4-edc2-494f-a7de-2bed877b5184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.695580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e81cb4-edc2-494f-a7de-2bed877b5184 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.700806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-70fdc754-a85b-4ed6-9ffa-f1ef22aef89b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:41.702013 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-70fdc754-a85b-4ed6-9ffa-f1ef22aef89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.705973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1048/2098] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:41.707720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f72c9-2272-4964-92bc-169de8129039 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.708013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f72c9-2272-4964-92bc-169de8129039 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.708300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f72c9-2272-4964-92bc-169de8129039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.711694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1051/2099] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:41.712695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdc754-a85b-4ed6-9ffa-f1ef22aef89b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.720786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-70fdc754-a85b-4ed6-9ffa-f1ef22aef89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.727586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4b0f72c9-2272-4964-92bc-169de8129039 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:41.728842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4b0f72c9-2272-4964-92bc-169de8129039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.736308 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdc754-a85b-4ed6-9ffa-f1ef22aef89b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.737749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1049/2100] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:41.739089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2275-050e-4054-9d2d-6a934521b8f0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.739387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2275-050e-4054-9d2d-6a934521b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.739656 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2275-050e-4054-9d2d-6a934521b8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.744251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35b228-5010-42c6-bcc0-09a27d90f620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.745091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35b228-5010-42c6-bcc0-09a27d90f620 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.745489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35b228-5010-42c6-bcc0-09a27d90f620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.745828 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35b228-5010-42c6-bcc0-09a27d90f620 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.746646 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35b228-5010-42c6-bcc0-09a27d90f620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.748389 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35b228-5010-42c6-bcc0-09a27d90f620 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.758276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-58ce2275-050e-4054-9d2d-6a934521b8f0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:41.762340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1052/2101] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:41.762470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-58ce2275-050e-4054-9d2d-6a934521b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.762562 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35b228-5010-42c6-bcc0-09a27d90f620 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.771748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1050/2102] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:41.771748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2275-050e-4054-9d2d-6a934521b8f0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.772000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35b228-5010-42c6-bcc0-09a27d90f620 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.775117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da8a8a-9871-4e9e-9356-3773b9fbf825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.775762 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da8a8a-9871-4e9e-9356-3773b9fbf825 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.776043 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da8a8a-9871-4e9e-9356-3773b9fbf825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.776319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da8a8a-9871-4e9e-9356-3773b9fbf825 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.777078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da8a8a-9871-4e9e-9356-3773b9fbf825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:41.777385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da8a8a-9871-4e9e-9356-3773b9fbf825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.778976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da8a8a-9871-4e9e-9356-3773b9fbf825 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.779346 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2275-050e-4054-9d2d-6a934521b8f0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.784104 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1972a-bf14-4369-80a3-142b8b529142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.785196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1972a-bf14-4369-80a3-142b8b529142 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.785477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1972a-bf14-4369-80a3-142b8b529142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.785743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1972a-bf14-4369-80a3-142b8b529142 admin admin] PATH_INFO: `/v3/projects/277266a3399f4ad48cef5966ae2987c8/users/109a0c4d2840471bad9d4985927d06ab/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.790766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1053/2103] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:41.791558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da8a8a-9871-4e9e-9356-3773b9fbf825 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.800211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1972a-bf14-4369-80a3-142b8b529142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277266a3399f4ad48cef5966ae2987c8, user_id=109a0c4d2840471bad9d4985927d06ab, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.801146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da8a8a-9871-4e9e-9356-3773b9fbf825 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.803600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1972a-bf14-4369-80a3-142b8b529142 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.805764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bc7ee-6ac9-40b6-b8a9-9eebcc75d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.806390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bc7ee-6ac9-40b6-b8a9-9eebcc75d47f admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.806676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bc7ee-6ac9-40b6-b8a9-9eebcc75d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.806951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bc7ee-6ac9-40b6-b8a9-9eebcc75d47f admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.807672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bc7ee-6ac9-40b6-b8a9-9eebcc75d47f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:41.807975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bc7ee-6ac9-40b6-b8a9-9eebcc75d47f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.809896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bc7ee-6ac9-40b6-b8a9-9eebcc75d47f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.817431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1051/2104] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:41 2022] PUT /identity/v3/projects/277266a3399f4ad48cef5966ae2987c8/users/109a0c4d2840471bad9d4985927d06ab/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:41.818420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1972a-bf14-4369-80a3-142b8b529142 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.822259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1054/2105] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:41.826493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bc7ee-6ac9-40b6-b8a9-9eebcc75d47f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.836804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bc7ee-6ac9-40b6-b8a9-9eebcc75d47f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.881779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1972a-bf14-4369-80a3-142b8b529142 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.888477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13105913-890c-4673-88d2-e70b30a377e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.889132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13105913-890c-4673-88d2-e70b30a377e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.889414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13105913-890c-4673-88d2-e70b30a377e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.889686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13105913-890c-4673-88d2-e70b30a377e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.890390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13105913-890c-4673-88d2-e70b30a377e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.892386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13105913-890c-4673-88d2-e70b30a377e4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.896540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd1bc0-f774-4331-898b-9f5d754a7482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.897194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd1bc0-f774-4331-898b-9f5d754a7482 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.897502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd1bc0-f774-4331-898b-9f5d754a7482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.897773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd1bc0-f774-4331-898b-9f5d754a7482 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.898467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd1bc0-f774-4331-898b-9f5d754a7482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:41.900374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd1bc0-f774-4331-898b-9f5d754a7482 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:41.918543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1052/2106] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:41.922239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ae64-8ac0-4c04-97f4-4afaa9c03f3c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.922239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ae64-8ac0-4c04-97f4-4afaa9c03f3c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.925531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ae64-8ac0-4c04-97f4-4afaa9c03f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.927347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1055/2107] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:41.928086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd1bc0-f774-4331-898b-9f5d754a7482 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:41.956069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-50b7ae64-8ac0-4c04-97f4-4afaa9c03f3c None None] MFA Rules not processed for user `109a0c4d2840471bad9d4985927d06ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:41.957930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-50b7ae64-8ac0-4c04-97f4-4afaa9c03f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:41.991538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd1bc0-f774-4331-898b-9f5d754a7482 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:41.996485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e742-9e0b-4998-9467-3d7fc287316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:41.997151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e742-9e0b-4998-9467-3d7fc287316a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:41.997432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e742-9e0b-4998-9467-3d7fc287316a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:41.997712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e742-9e0b-4998-9467-3d7fc287316a admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:41.998425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088e742-9e0b-4998-9467-3d7fc287316a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.000366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088e742-9e0b-4998-9467-3d7fc287316a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.024537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1053/2108] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:42.027558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7ae64-8ac0-4c04-97f4-4afaa9c03f3c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.031617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1056/2109] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:41 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:42.033641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e742-9e0b-4998-9467-3d7fc287316a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.035757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5088e742-9e0b-4998-9467-3d7fc287316a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:42.041321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7ae64-8ac0-4c04-97f4-4afaa9c03f3c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.045977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237097ba-20db-4856-91e4-7abbbe79f84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.046646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237097ba-20db-4856-91e4-7abbbe79f84f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.046931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237097ba-20db-4856-91e4-7abbbe79f84f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.047209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237097ba-20db-4856-91e4-7abbbe79f84f admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.047916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237097ba-20db-4856-91e4-7abbbe79f84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.049877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237097ba-20db-4856-91e4-7abbbe79f84f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.072184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1054/2110] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:42 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:42.073384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237097ba-20db-4856-91e4-7abbbe79f84f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.084095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237097ba-20db-4856-91e4-7abbbe79f84f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.089038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476cb6a-bede-4d0e-b1dc-a0fa80f3d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.089696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476cb6a-bede-4d0e-b1dc-a0fa80f3d5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.089984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476cb6a-bede-4d0e-b1dc-a0fa80f3d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.090323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476cb6a-bede-4d0e-b1dc-a0fa80f3d5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.091195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476cb6a-bede-4d0e-b1dc-a0fa80f3d5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.093144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476cb6a-bede-4d0e-b1dc-a0fa80f3d5a5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.106779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1055/2111] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:42.106779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476cb6a-bede-4d0e-b1dc-a0fa80f3d5a5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.107030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e742-9e0b-4998-9467-3d7fc287316a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.114247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd90ab0-3aa5-4646-8a97-924ce328845e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.114980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd90ab0-3aa5-4646-8a97-924ce328845e service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.115270 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd90ab0-3aa5-4646-8a97-924ce328845e service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.115702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd90ab0-3aa5-4646-8a97-924ce328845e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.118793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476cb6a-bede-4d0e-b1dc-a0fa80f3d5a5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.124286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876fbb-470d-4999-9e57-d366c2854309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.125199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876fbb-470d-4999-9e57-d366c2854309 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.125341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd90ab0-3aa5-4646-8a97-924ce328845e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.125665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876fbb-470d-4999-9e57-d366c2854309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.126039 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04876fbb-470d-4999-9e57-d366c2854309 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.126775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd90ab0-3aa5-4646-8a97-924ce328845e service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.127109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04876fbb-470d-4999-9e57-d366c2854309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.129411 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04876fbb-470d-4999-9e57-d366c2854309 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.136878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1057/2112] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:42.137777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd90ab0-3aa5-4646-8a97-924ce328845e service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.143462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1056/2113] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:42.145903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876fbb-470d-4999-9e57-d366c2854309 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.149928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd90ab0-3aa5-4646-8a97-924ce328845e service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.154403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0853a9-213f-4783-9b38-d745611e4881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.155069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0853a9-213f-4783-9b38-d745611e4881 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.155352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0853a9-213f-4783-9b38-d745611e4881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.155630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0853a9-213f-4783-9b38-d745611e4881 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.156402 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0853a9-213f-4783-9b38-d745611e4881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.157734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04876fbb-470d-4999-9e57-d366c2854309 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.158040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0853a9-213f-4783-9b38-d745611e4881 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.164531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229fc7c-c021-45ca-9dee-4539998fcda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.165370 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229fc7c-c021-45ca-9dee-4539998fcda9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.165754 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229fc7c-c021-45ca-9dee-4539998fcda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.166133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229fc7c-c021-45ca-9dee-4539998fcda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.166977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229fc7c-c021-45ca-9dee-4539998fcda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.168715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229fc7c-c021-45ca-9dee-4539998fcda9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.176281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1058/2114] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:42.188380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0853a9-213f-4783-9b38-d745611e4881 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.188574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1057/2115] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:42.190307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229fc7c-c021-45ca-9dee-4539998fcda9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.203621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229fc7c-c021-45ca-9dee-4539998fcda9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.209002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0853a9-213f-4783-9b38-d745611e4881 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.210042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7834-353b-46d1-9fe2-db0788979253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.211270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7834-353b-46d1-9fe2-db0788979253 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.211659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7834-353b-46d1-9fe2-db0788979253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.212059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7834-353b-46d1-9fe2-db0788979253 admin admin] PATH_INFO: `/v3/projects/4914803902b7433a91c1a145530d36d0/users/7c708e2f55124bc496bd77bc6f052c4d/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.214314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d74d-bc9c-4152-9c0d-48bf5294c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.215212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d74d-bc9c-4152-9c0d-48bf5294c4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.215497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d74d-bc9c-4152-9c0d-48bf5294c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.215768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d74d-bc9c-4152-9c0d-48bf5294c4cf admin admin] PATH_INFO: `/v3/projects/1d04c0f05c4c4e3984b8148119a446dc/users/bf7fbbbbfc3c4653ae24acd1a13b8e4e/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.229704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc7834-353b-46d1-9fe2-db0788979253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4914803902b7433a91c1a145530d36d0, user_id=7c708e2f55124bc496bd77bc6f052c4d, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.232600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc7834-353b-46d1-9fe2-db0788979253 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.234874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d74d-bc9c-4152-9c0d-48bf5294c4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d04c0f05c4c4e3984b8148119a446dc, user_id=bf7fbbbbfc3c4653ae24acd1a13b8e4e, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.238037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11d74d-bc9c-4152-9c0d-48bf5294c4cf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.247832 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1058/2116] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:42 2022] PUT /identity/v3/projects/4914803902b7433a91c1a145530d36d0/users/7c708e2f55124bc496bd77bc6f052c4d/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:42.256536 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1059/2117] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:42 2022] PUT /identity/v3/projects/1d04c0f05c4c4e3984b8148119a446dc/users/bf7fbbbbfc3c4653ae24acd1a13b8e4e/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:42.263173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c7714-9105-4e70-ac11-011818214e80 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.263548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c7714-9105-4e70-ac11-011818214e80 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.263903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c7714-9105-4e70-ac11-011818214e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.267046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac575a-3fc8-44bd-a0cc-67af1efc2d6d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.267495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac575a-3fc8-44bd-a0cc-67af1efc2d6d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.267854 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac575a-3fc8-44bd-a0cc-67af1efc2d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.295770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-212c7714-9105-4e70-ac11-011818214e80 None None] MFA Rules not processed for user `7c708e2f55124bc496bd77bc6f052c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:42.296370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-53ac575a-3fc8-44bd-a0cc-67af1efc2d6d None None] MFA Rules not processed for user `bf7fbbbbfc3c4653ae24acd1a13b8e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:42.297325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-212c7714-9105-4e70-ac11-011818214e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:42.297574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-53ac575a-3fc8-44bd-a0cc-67af1efc2d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:42.369806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1060/2118] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:42.377215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1059/2119] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:42.381464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac575a-3fc8-44bd-a0cc-67af1efc2d6d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.382809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c7714-9105-4e70-ac11-011818214e80 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.383056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-53ac575a-3fc8-44bd-a0cc-67af1efc2d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:42.453393 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c7714-9105-4e70-ac11-011818214e80 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.455292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac575a-3fc8-44bd-a0cc-67af1efc2d6d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.459766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f637c-8450-4302-8613-3efc60cf8387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.459976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f700b-18c3-4d9b-a1ee-b76b060f6e5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.460450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f637c-8450-4302-8613-3efc60cf8387 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.460707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f700b-18c3-4d9b-a1ee-b76b060f6e5f service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.460819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f637c-8450-4302-8613-3efc60cf8387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.460989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f637c-8450-4302-8613-3efc60cf8387 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.461098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f700b-18c3-4d9b-a1ee-b76b060f6e5f service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.461307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f700b-18c3-4d9b-a1ee-b76b060f6e5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.461874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f637c-8450-4302-8613-3efc60cf8387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.464189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f637c-8450-4302-8613-3efc60cf8387 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.487028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f700b-18c3-4d9b-a1ee-b76b060f6e5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.489451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f700b-18c3-4d9b-a1ee-b76b060f6e5f service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.500547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1061/2120] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:42.507460 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1060/2121] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:42 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:42.512540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f700b-18c3-4d9b-a1ee-b76b060f6e5f service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.521252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f637c-8450-4302-8613-3efc60cf8387 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.523291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f700b-18c3-4d9b-a1ee-b76b060f6e5f service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.589291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03eac-236b-40cb-9260-528224953e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.589291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03eac-236b-40cb-9260-528224953e76 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.589291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03eac-236b-40cb-9260-528224953e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.589291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed03eac-236b-40cb-9260-528224953e76 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.589888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed03eac-236b-40cb-9260-528224953e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.591819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed03eac-236b-40cb-9260-528224953e76 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.599332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f637c-8450-4302-8613-3efc60cf8387 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.604592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.605605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.606064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.606414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] PATH_INFO: `/v3/users/bf7fbbbbfc3c4653ae24acd1a13b8e4e` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.607725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7fbbbbfc3c4653ae24acd1a13b8e4e)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.609749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.614002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1062/2122] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:42 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:42.620786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03eac-236b-40cb-9260-528224953e76 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.631490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed03eac-236b-40cb-9260-528224953e76 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.636858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c09a4-2bc1-4c65-a6be-71c78891306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.637908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c09a4-2bc1-4c65-a6be-71c78891306a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.638235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c09a4-2bc1-4c65-a6be-71c78891306a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.638511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c09a4-2bc1-4c65-a6be-71c78891306a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.639387 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c09a4-2bc1-4c65-a6be-71c78891306a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.641132 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c09a4-2bc1-4c65-a6be-71c78891306a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.656708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1063/2123] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:42.657996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c09a4-2bc1-4c65-a6be-71c78891306a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.669138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7fbbbbfc3c4653ae24acd1a13b8e4e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:42.670489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c09a4-2bc1-4c65-a6be-71c78891306a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.677479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a24f-60d0-44fd-99db-45d750efad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.678150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7fbbbbfc3c4653ae24acd1a13b8e4e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:42.678372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a24f-60d0-44fd-99db-45d750efad56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.678652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a24f-60d0-44fd-99db-45d750efad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.679026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a24f-60d0-44fd-99db-45d750efad56 admin admin] PATH_INFO: `/v3/projects/d1caa5718ebf44b995a10aab8051df73/users/e4eb7387d827403e84a770e829d090e8/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.690186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7fbbbbfc3c4653ae24acd1a13b8e4e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:42.691584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7fbbbbfc3c4653ae24acd1a13b8e4e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:42.694601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56a24f-60d0-44fd-99db-45d750efad56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1caa5718ebf44b995a10aab8051df73, user_id=e4eb7387d827403e84a770e829d090e8, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.697296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56a24f-60d0-44fd-99db-45d750efad56 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.699559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-71df63cd-ce1b-4e3e-8ffa-bb2eaebc7be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7fbbbbfc3c4653ae24acd1a13b8e4e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:42.705680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1061/2124] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:42 2022] DELETE /identity/v3/users/bf7fbbbbfc3c4653ae24acd1a13b8e4e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:42.710577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17c6d0-d2a8-4e8b-a9ee-c8119f033b70 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.710867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17c6d0-d2a8-4e8b-a9ee-c8119f033b70 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.711146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17c6d0-d2a8-4e8b-a9ee-c8119f033b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.711618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1064/2125] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:42 2022] PUT /identity/v3/projects/d1caa5718ebf44b995a10aab8051df73/users/e4eb7387d827403e84a770e829d090e8/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:42.715321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a24f-60d0-44fd-99db-45d750efad56 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.717013 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2d56a24f-60d0-44fd-99db-45d750efad56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:42.728737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9f17c6d0-d2a8-4e8b-a9ee-c8119f033b70 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:42.730076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9f17c6d0-d2a8-4e8b-a9ee-c8119f033b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:42.785766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a24f-60d0-44fd-99db-45d750efad56 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.788014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1062/2126] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:42.790383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db4804-8d13-4387-ab73-b0cc6942472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.791058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db4804-8d13-4387-ab73-b0cc6942472c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.791327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db4804-8d13-4387-ab73-b0cc6942472c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.791599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db4804-8d13-4387-ab73-b0cc6942472c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.792385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db4804-8d13-4387-ab73-b0cc6942472c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.794003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db4804-8d13-4387-ab73-b0cc6942472c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.798240 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17c6d0-d2a8-4e8b-a9ee-c8119f033b70 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.799563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9f17c6d0-d2a8-4e8b-a9ee-c8119f033b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:42.807126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1065/2127] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:42.808045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db4804-8d13-4387-ab73-b0cc6942472c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.818506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db4804-8d13-4387-ab73-b0cc6942472c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.823471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0fd65-beac-4d4a-a315-77da62501e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.824318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0fd65-beac-4d4a-a315-77da62501e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.824633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0fd65-beac-4d4a-a315-77da62501e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.824908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0fd65-beac-4d4a-a315-77da62501e7b admin admin] PATH_INFO: `/v3/projects/d1caa5718ebf44b995a10aab8051df73/users/e4eb7387d827403e84a770e829d090e8/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.826950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0fd65-beac-4d4a-a315-77da62501e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1caa5718ebf44b995a10aab8051df73, user_id=e4eb7387d827403e84a770e829d090e8, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.829633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0fd65-beac-4d4a-a315-77da62501e7b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.840994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1066/2128] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:42 2022] PUT /identity/v3/projects/d1caa5718ebf44b995a10aab8051df73/users/e4eb7387d827403e84a770e829d090e8/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:42.852105 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e546d45-3b4b-4b46-88e1-5285491c0394 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.852447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e546d45-3b4b-4b46-88e1-5285491c0394 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.852755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e546d45-3b4b-4b46-88e1-5285491c0394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.858361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17c6d0-d2a8-4e8b-a9ee-c8119f033b70 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:42.889212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8e546d45-3b4b-4b46-88e1-5285491c0394 None None] MFA Rules not processed for user `e4eb7387d827403e84a770e829d090e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:42.889817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8e546d45-3b4b-4b46-88e1-5285491c0394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:42.911379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07294e-84f8-40d9-becc-a86b7d92233a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:42.912046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07294e-84f8-40d9-becc-a86b7d92233a service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:42.912328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07294e-84f8-40d9-becc-a86b7d92233a service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:42.912631 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07294e-84f8-40d9-becc-a86b7d92233a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:42.958723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1067/2129] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:42.968285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e546d45-3b4b-4b46-88e1-5285491c0394 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:42.970790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8e546d45-3b4b-4b46-88e1-5285491c0394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:42.978520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07294e-84f8-40d9-becc-a86b7d92233a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:42.979968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07294e-84f8-40d9-becc-a86b7d92233a service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:42.990559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1063/2130] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:43.028994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e546d45-3b4b-4b46-88e1-5285491c0394 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.033957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723b193-4757-431d-9dc3-6ce6f6d18593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.034641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723b193-4757-431d-9dc3-6ce6f6d18593 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.035083 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723b193-4757-431d-9dc3-6ce6f6d18593 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.035361 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723b193-4757-431d-9dc3-6ce6f6d18593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.045400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723b193-4757-431d-9dc3-6ce6f6d18593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.046827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723b193-4757-431d-9dc3-6ce6f6d18593 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.057918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1068/2131] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:43.308720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07294e-84f8-40d9-becc-a86b7d92233a service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:43.310208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9a07294e-84f8-40d9-becc-a86b7d92233a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:43.340793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07294e-84f8-40d9-becc-a86b7d92233a service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.349359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.350442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.350737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.351070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] PATH_INFO: `/v3/projects/1d04c0f05c4c4e3984b8148119a446dc` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.353058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d04c0f05c4c4e3984b8148119a446dc)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.355104 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.408101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d04c0f05c4c4e3984b8148119a446dc', 'request_id': 'req-c6489eba-7cf3-466a-a218-f2f7ff2bc907'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.415517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d04c0f05c4c4e3984b8148119a446dc', 'request_id': 'req-c6489eba-7cf3-466a-a218-f2f7ff2bc907'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.421235 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d04c0f05c4c4e3984b8148119a446dc', 'request_id': 'req-c6489eba-7cf3-466a-a218-f2f7ff2bc907'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.435448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] The token cache is being invalidate because project 1d04c0f05c4c4e3984b8148119a446dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:43.435874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.436716 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6489eba-7cf3-466a-a218-f2f7ff2bc907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.438666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1064/2132] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:43 2022] DELETE /identity/v3/projects/1d04c0f05c4c4e3984b8148119a446dc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:43.444011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90d58-2d2e-403f-ab7f-5c82c4d379a2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.444303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90d58-2d2e-403f-ab7f-5c82c4d379a2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.444611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90d58-2d2e-403f-ab7f-5c82c4d379a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.463277 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f0e90d58-2d2e-403f-ab7f-5c82c4d379a2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:43.464520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f0e90d58-2d2e-403f-ab7f-5c82c4d379a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:43.542060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1069/2133] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:43.549438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f383efc-e28f-4691-9468-be24aae53d1d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.549727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f383efc-e28f-4691-9468-be24aae53d1d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.550103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f383efc-e28f-4691-9468-be24aae53d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.569654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3f383efc-e28f-4691-9468-be24aae53d1d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:43.570890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3f383efc-e28f-4691-9468-be24aae53d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:43.579191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1065/2134] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:43.583938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90d58-2d2e-403f-ab7f-5c82c4d379a2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:43.593463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90d58-2d2e-403f-ab7f-5c82c4d379a2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.599124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.599839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.600243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.600623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.601515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:43.601776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.603472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.619656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1070/2135] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:43.620804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f383efc-e28f-4691-9468-be24aae53d1d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:43.622328 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:43.629213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:43.633189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f383efc-e28f-4691-9468-be24aae53d1d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.637876 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac201812-7343-40b1-b329-2dec1f64ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.638860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac201812-7343-40b1-b329-2dec1f64ffb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.639138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac201812-7343-40b1-b329-2dec1f64ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.639410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac201812-7343-40b1-b329-2dec1f64ffb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.640117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac201812-7343-40b1-b329-2dec1f64ffb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.642091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac201812-7343-40b1-b329-2dec1f64ffb2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.644509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d0866-0185-4692-b867-30418b3b66b7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.649415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.650382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.650730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.651075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] PATH_INFO: `/v3/users/7c708e2f55124bc496bd77bc6f052c4d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.652384 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c708e2f55124bc496bd77bc6f052c4d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.654385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.674294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1066/2136] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:43 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:43.679798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac201812-7343-40b1-b329-2dec1f64ffb2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:43.705396 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c708e2f55124bc496bd77bc6f052c4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.713640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c708e2f55124bc496bd77bc6f052c4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.720876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c708e2f55124bc496bd77bc6f052c4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.732986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c708e2f55124bc496bd77bc6f052c4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.733707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-164af0ac-a787-496a-868a-d44e85f7c92e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c708e2f55124bc496bd77bc6f052c4d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:43.739389 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1071/2137] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:43 2022] DELETE /identity/v3/users/7c708e2f55124bc496bd77bc6f052c4d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:43.743792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af064a-a2d9-460d-9a6d-bf8131e90d83 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.744075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af064a-a2d9-460d-9a6d-bf8131e90d83 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.744370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af064a-a2d9-460d-9a6d-bf8131e90d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.746612 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac201812-7343-40b1-b329-2dec1f64ffb2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.765098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-b1af064a-a2d9-460d-9a6d-bf8131e90d83 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:43.766300 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b1af064a-a2d9-460d-9a6d-bf8131e90d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:43.810454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3bf61-1e35-467a-8a36-73f94a4b6883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.811032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3bf61-1e35-467a-8a36-73f94a4b6883 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.811362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3bf61-1e35-467a-8a36-73f94a4b6883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.811806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3bf61-1e35-467a-8a36-73f94a4b6883 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.812458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3bf61-1e35-467a-8a36-73f94a4b6883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.814442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3bf61-1e35-467a-8a36-73f94a4b6883 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.828540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1072/2138] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:43.834801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1067/2139] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:43 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:43.838758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af064a-a2d9-460d-9a6d-bf8131e90d83 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:43.840261 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b1af064a-a2d9-460d-9a6d-bf8131e90d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:43.842185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3bf61-1e35-467a-8a36-73f94a4b6883 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:43.843771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d4d3bf61-1e35-467a-8a36-73f94a4b6883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:43.853130 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af064a-a2d9-460d-9a6d-bf8131e90d83 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.858139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039519-1ee0-460c-8aed-18defa022a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.858811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039519-1ee0-460c-8aed-18defa022a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.859096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039519-1ee0-460c-8aed-18defa022a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.859371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039519-1ee0-460c-8aed-18defa022a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.860114 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9039519-1ee0-460c-8aed-18defa022a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.861800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9039519-1ee0-460c-8aed-18defa022a9b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.871897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1073/2140] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:43.875723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039519-1ee0-460c-8aed-18defa022a9b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:43.887949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039519-1ee0-460c-8aed-18defa022a9b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.892752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5f8e9-67a2-486e-89b2-69e2364f3948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.893404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5f8e9-67a2-486e-89b2-69e2364f3948 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.894211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5f8e9-67a2-486e-89b2-69e2364f3948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.894575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5f8e9-67a2-486e-89b2-69e2364f3948 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.895312 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5f8e9-67a2-486e-89b2-69e2364f3948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.896934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5f8e9-67a2-486e-89b2-69e2364f3948 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.902900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3bf61-1e35-467a-8a36-73f94a4b6883 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.906766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1074/2141] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:43.906896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96318366-0d7c-4931-b743-fe05aa2141f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.909057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318366-0d7c-4931-b743-fe05aa2141f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.909394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318366-0d7c-4931-b743-fe05aa2141f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.910178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318366-0d7c-4931-b743-fe05aa2141f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.911459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5f8e9-67a2-486e-89b2-69e2364f3948 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:43.919522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96318366-0d7c-4931-b743-fe05aa2141f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.920827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5f8e9-67a2-486e-89b2-69e2364f3948 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:43.921001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96318366-0d7c-4931-b743-fe05aa2141f1 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.925482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be638147-8926-4eff-b4f5-827b053db648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:43.926399 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be638147-8926-4eff-b4f5-827b053db648 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.926679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be638147-8926-4eff-b4f5-827b053db648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.926953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be638147-8926-4eff-b4f5-827b053db648 admin admin] PATH_INFO: `/v3/projects/86d2e59c240e4978811056c1b77c5980/users/0e8efc8157234567bcc9487e175cabb7/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.930507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1068/2142] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:43.941184 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be638147-8926-4eff-b4f5-827b053db648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d2e59c240e4978811056c1b77c5980, user_id=0e8efc8157234567bcc9487e175cabb7, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:43.943811 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be638147-8926-4eff-b4f5-827b053db648 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:43.957704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1075/2143] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:43 2022] PUT /identity/v3/projects/86d2e59c240e4978811056c1b77c5980/users/0e8efc8157234567bcc9487e175cabb7/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:43.970152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ca96f-beb5-472f-a42a-8b0230762047 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:43.970455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ca96f-beb5-472f-a42a-8b0230762047 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:43.970731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ca96f-beb5-472f-a42a-8b0230762047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:43.999697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-794ca96f-beb5-472f-a42a-8b0230762047 None None] MFA Rules not processed for user `0e8efc8157234567bcc9487e175cabb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:44.000955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-794ca96f-beb5-472f-a42a-8b0230762047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:44.077224 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1069/2144] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:44.090472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be638147-8926-4eff-b4f5-827b053db648 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:44.092300 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-be638147-8926-4eff-b4f5-827b053db648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:44.159536 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be638147-8926-4eff-b4f5-827b053db648 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:44.163299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a8ee-d113-4aff-96ea-2809cf0df157 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '612a02fb42af490abcba0e75ec8c759f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:44.163940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a8ee-d113-4aff-96ea-2809cf0df157 service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:44.164221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a8ee-d113-4aff-96ea-2809cf0df157 service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:44.164531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a8ee-d113-4aff-96ea-2809cf0df157 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:44.172855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a8ee-d113-4aff-96ea-2809cf0df157 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:44.174419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a8ee-d113-4aff-96ea-2809cf0df157 service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:44.183119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1076/2145] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:44.210499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ca96f-beb5-472f-a42a-8b0230762047 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:44.212167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-794ca96f-beb5-472f-a42a-8b0230762047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:44.292424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ca96f-beb5-472f-a42a-8b0230762047 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:44.298659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:44.299518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:44.299797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:44.300121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] PATH_INFO: `/v3/projects/4914803902b7433a91c1a145530d36d0` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:44.301490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4914803902b7433a91c1a145530d36d0)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:44.303444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:44.351315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4914803902b7433a91c1a145530d36d0', 'request_id': 'req-2525bd49-56e9-4475-ab97-5708ab4a23f6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.360695 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4914803902b7433a91c1a145530d36d0', 'request_id': 'req-2525bd49-56e9-4475-ab97-5708ab4a23f6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.368037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4914803902b7433a91c1a145530d36d0', 'request_id': 'req-2525bd49-56e9-4475-ab97-5708ab4a23f6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.382251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] The token cache is being invalidate because project 4914803902b7433a91c1a145530d36d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:44.382561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.383203 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.385000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1070/2146] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:44 2022] DELETE /identity/v3/projects/4914803902b7433a91c1a145530d36d0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:44.388853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a8ee-d113-4aff-96ea-2809cf0df157 service glance] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:44.399820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a8ee-d113-4aff-96ea-2809cf0df157 service glance] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:44.475035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:44.475913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:44.476308 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:44.476474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] PATH_INFO: `/v3/users/e4eb7387d827403e84a770e829d090e8` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:44.478024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4eb7387d827403e84a770e829d090e8)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:44.480151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:44.532182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4eb7387d827403e84a770e829d090e8'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.540279 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4eb7387d827403e84a770e829d090e8'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.547169 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4eb7387d827403e84a770e829d090e8'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.561713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4eb7387d827403e84a770e829d090e8'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.565656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8f2c2028-40f4-4dcd-8f22-c50feca09085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4eb7387d827403e84a770e829d090e8'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:44.588331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1077/2147] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:44 2022] DELETE /identity/v3/users/e4eb7387d827403e84a770e829d090e8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:44.914076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:44.915576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:44.930137 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525bd49-56e9-4475-ab97-5708ab4a23f6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:44.998642 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:44.999486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:44.999763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.000033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] PATH_INFO: `/v3/projects/d1caa5718ebf44b995a10aab8051df73` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.001790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1caa5718ebf44b995a10aab8051df73)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.004468 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.049910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1caa5718ebf44b995a10aab8051df73', 'request_id': 'req-ae25e0a1-080d-458d-bb4d-2fceedf6156a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:45.056686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1caa5718ebf44b995a10aab8051df73', 'request_id': 'req-ae25e0a1-080d-458d-bb4d-2fceedf6156a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:45.062195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1caa5718ebf44b995a10aab8051df73', 'request_id': 'req-ae25e0a1-080d-458d-bb4d-2fceedf6156a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:45.076003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] The token cache is being invalidate because project d1caa5718ebf44b995a10aab8051df73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:45.076213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:45.076866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ae25e0a1-080d-458d-bb4d-2fceedf6156a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:45.078424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1071/2148] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:44 2022] DELETE /identity/v3/projects/d1caa5718ebf44b995a10aab8051df73 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:45.084726 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac0a44-b491-447e-8eeb-18ed064db5f4 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.085260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac0a44-b491-447e-8eeb-18ed064db5f4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.085418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac0a44-b491-447e-8eeb-18ed064db5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.104320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5bac0a44-b491-447e-8eeb-18ed064db5f4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:45.105776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5bac0a44-b491-447e-8eeb-18ed064db5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:45.165473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1078/2149] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:45.173393 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf3cae-eb9e-4df0-8e4e-e5d3abd751a8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.173689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf3cae-eb9e-4df0-8e4e-e5d3abd751a8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.173970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf3cae-eb9e-4df0-8e4e-e5d3abd751a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.198431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d3cf3cae-eb9e-4df0-8e4e-e5d3abd751a8 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:45.199766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d3cf3cae-eb9e-4df0-8e4e-e5d3abd751a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:45.208501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1072/2150] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:45.212797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac0a44-b491-447e-8eeb-18ed064db5f4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.227360 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac0a44-b491-447e-8eeb-18ed064db5f4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.235267 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b333d91-b5f8-444a-88ca-7cb663c732e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.236128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b333d91-b5f8-444a-88ca-7cb663c732e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.236501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b333d91-b5f8-444a-88ca-7cb663c732e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.236839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b333d91-b5f8-444a-88ca-7cb663c732e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.237727 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b333d91-b5f8-444a-88ca-7cb663c732e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:45.238030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b333d91-b5f8-444a-88ca-7cb663c732e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.239678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b333d91-b5f8-444a-88ca-7cb663c732e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.251856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1079/2151] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:45.255964 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf3cae-eb9e-4df0-8e4e-e5d3abd751a8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.265362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf3cae-eb9e-4df0-8e4e-e5d3abd751a8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.271035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5b48-b349-4c4d-8f3d-b86d3a4c56d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.271720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5b48-b349-4c4d-8f3d-b86d3a4c56d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.271991 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5b48-b349-4c4d-8f3d-b86d3a4c56d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.272415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5b48-b349-4c4d-8f3d-b86d3a4c56d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.273132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf5b48-b349-4c4d-8f3d-b86d3a4c56d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.274947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf5b48-b349-4c4d-8f3d-b86d3a4c56d1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.305800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1073/2152] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:45 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:45.307009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b333d91-b5f8-444a-88ca-7cb663c732e6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.317034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b333d91-b5f8-444a-88ca-7cb663c732e6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.382253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb2402-b07a-4d8c-85c0-c0d4aebd6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.382927 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb2402-b07a-4d8c-85c0-c0d4aebd6998 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.383211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb2402-b07a-4d8c-85c0-c0d4aebd6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.383488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb2402-b07a-4d8c-85c0-c0d4aebd6998 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.384242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb2402-b07a-4d8c-85c0-c0d4aebd6998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.386208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb2402-b07a-4d8c-85c0-c0d4aebd6998 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.407219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1080/2153] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:45 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:45.411921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5b48-b349-4c4d-8f3d-b86d3a4c56d1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.422305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5b48-b349-4c4d-8f3d-b86d3a4c56d1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.427251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf66d33-b904-4646-8b22-bf93ab43777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.427931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf66d33-b904-4646-8b22-bf93ab43777b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.428214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf66d33-b904-4646-8b22-bf93ab43777b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.428526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf66d33-b904-4646-8b22-bf93ab43777b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.429267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf66d33-b904-4646-8b22-bf93ab43777b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.430875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf66d33-b904-4646-8b22-bf93ab43777b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.444373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1074/2154] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:41:45.445820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb2402-b07a-4d8c-85c0-c0d4aebd6998 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.456887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb2402-b07a-4d8c-85c0-c0d4aebd6998 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.462459 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be356d48-1d00-4da9-8a0d-3fdd97cc4fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.463331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be356d48-1d00-4da9-8a0d-3fdd97cc4fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.463680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be356d48-1d00-4da9-8a0d-3fdd97cc4fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.464223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be356d48-1d00-4da9-8a0d-3fdd97cc4fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.465187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be356d48-1d00-4da9-8a0d-3fdd97cc4fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.467192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be356d48-1d00-4da9-8a0d-3fdd97cc4fb9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.479049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1081/2155] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:45.483220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf66d33-b904-4646-8b22-bf93ab43777b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.494057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf66d33-b904-4646-8b22-bf93ab43777b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.499167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc06b2-3648-4894-8e94-9646223a853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.500042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc06b2-3648-4894-8e94-9646223a853b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.500324 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc06b2-3648-4894-8e94-9646223a853b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.500632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc06b2-3648-4894-8e94-9646223a853b admin admin] PATH_INFO: `/v3/projects/73ba08008e854149b5c1297717632ed8/users/d2c24647fa2346fba74c22950e6a0eb7/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.516298 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc06b2-3648-4894-8e94-9646223a853b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ba08008e854149b5c1297717632ed8, user_id=d2c24647fa2346fba74c22950e6a0eb7, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.519604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc06b2-3648-4894-8e94-9646223a853b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.532447 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1075/2156] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:45 2022] PUT /identity/v3/projects/73ba08008e854149b5c1297717632ed8/users/d2c24647fa2346fba74c22950e6a0eb7/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:45.543967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1cb3-4289-4dc9-b92d-89f4813c3b0b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.544447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1cb3-4289-4dc9-b92d-89f4813c3b0b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.544740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de1cb3-4289-4dc9-b92d-89f4813c3b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.582815 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-78de1cb3-4289-4dc9-b92d-89f4813c3b0b None None] MFA Rules not processed for user `d2c24647fa2346fba74c22950e6a0eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:45.584086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-78de1cb3-4289-4dc9-b92d-89f4813c3b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:45.648060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1082/2157] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:45.652549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc06b2-3648-4894-8e94-9646223a853b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.723493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc06b2-3648-4894-8e94-9646223a853b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.728903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcee5e-d699-4b61-994e-0236f2026096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.729668 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcee5e-d699-4b61-994e-0236f2026096 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.730045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcee5e-d699-4b61-994e-0236f2026096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.730414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcee5e-d699-4b61-994e-0236f2026096 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.731349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcee5e-d699-4b61-994e-0236f2026096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.733734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcee5e-d699-4b61-994e-0236f2026096 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.773508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1076/2158] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:45 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:45.777562 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de1cb3-4289-4dc9-b92d-89f4813c3b0b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.788624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de1cb3-4289-4dc9-b92d-89f4813c3b0b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.843482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9241f3-c67a-49ff-83cd-2da6d3986461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.844141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9241f3-c67a-49ff-83cd-2da6d3986461 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.844447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9241f3-c67a-49ff-83cd-2da6d3986461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.844719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9241f3-c67a-49ff-83cd-2da6d3986461 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.845423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9241f3-c67a-49ff-83cd-2da6d3986461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.847367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9241f3-c67a-49ff-83cd-2da6d3986461 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.868247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1083/2159] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:45 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:45.871936 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcee5e-d699-4b61-994e-0236f2026096 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.882622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcee5e-d699-4b61-994e-0236f2026096 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.887177 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81326a78-a42a-486e-ad9b-3dbbb00cd626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.887815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81326a78-a42a-486e-ad9b-3dbbb00cd626 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.888091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81326a78-a42a-486e-ad9b-3dbbb00cd626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.888386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81326a78-a42a-486e-ad9b-3dbbb00cd626 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.889117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81326a78-a42a-486e-ad9b-3dbbb00cd626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.890706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81326a78-a42a-486e-ad9b-3dbbb00cd626 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.906482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1077/2160] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:45.910655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9241f3-c67a-49ff-83cd-2da6d3986461 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.920577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9241f3-c67a-49ff-83cd-2da6d3986461 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:45.925684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7029b-4825-40ef-bb20-d7e703cab0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:45.926550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7029b-4825-40ef-bb20-d7e703cab0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:45.926823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7029b-4825-40ef-bb20-d7e703cab0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:45.927095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7029b-4825-40ef-bb20-d7e703cab0a4 admin admin] PATH_INFO: `/v3/projects/a8d73b3b91d84720b68f6358ffb52776/users/eb80b02287b640aaa5d5d4bb4272e534/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:45.941853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7029b-4825-40ef-bb20-d7e703cab0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d73b3b91d84720b68f6358ffb52776, user_id=eb80b02287b640aaa5d5d4bb4272e534, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:45.944612 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7029b-4825-40ef-bb20-d7e703cab0a4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:45.957599 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1084/2161] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:45 2022] PUT /identity/v3/projects/a8d73b3b91d84720b68f6358ffb52776/users/eb80b02287b640aaa5d5d4bb4272e534/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:45.961577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81326a78-a42a-486e-ad9b-3dbbb00cd626 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:45.971418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81326a78-a42a-486e-ad9b-3dbbb00cd626 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:46.024792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53f784-9a15-4322-9234-95f567215c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:46.025451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53f784-9a15-4322-9234-95f567215c2c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:46.025729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53f784-9a15-4322-9234-95f567215c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:46.025999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53f784-9a15-4322-9234-95f567215c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:46.026751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53f784-9a15-4322-9234-95f567215c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:46.028391 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53f784-9a15-4322-9234-95f567215c2c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:46.038025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1078/2162] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:46.042229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7029b-4825-40ef-bb20-d7e703cab0a4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:46.052707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7029b-4825-40ef-bb20-d7e703cab0a4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:46.057704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877629-2373-4fc3-a139-a2a6ff07b6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:46.058566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877629-2373-4fc3-a139-a2a6ff07b6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:46.058843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877629-2373-4fc3-a139-a2a6ff07b6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:46.059115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877629-2373-4fc3-a139-a2a6ff07b6b3 admin admin] PATH_INFO: `/v3/projects/a8d73b3b91d84720b68f6358ffb52776/users/eb80b02287b640aaa5d5d4bb4272e534/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:46.061095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18877629-2373-4fc3-a139-a2a6ff07b6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d73b3b91d84720b68f6358ffb52776, user_id=eb80b02287b640aaa5d5d4bb4272e534, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:46.063683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18877629-2373-4fc3-a139-a2a6ff07b6b3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:46.074440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1085/2163] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:46 2022] PUT /identity/v3/projects/a8d73b3b91d84720b68f6358ffb52776/users/eb80b02287b640aaa5d5d4bb4272e534/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:46.084283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7562-99b1-422d-80cc-93ccaa891624 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:46.084606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7562-99b1-422d-80cc-93ccaa891624 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:46.084907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7562-99b1-422d-80cc-93ccaa891624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:46.111493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-12eb7562-99b1-422d-80cc-93ccaa891624 None None] MFA Rules not processed for user `eb80b02287b640aaa5d5d4bb4272e534`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:46.113232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-12eb7562-99b1-422d-80cc-93ccaa891624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:46.178723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1079/2164] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:46.189579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877629-2373-4fc3-a139-a2a6ff07b6b3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:46.191939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-18877629-2373-4fc3-a139-a2a6ff07b6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:46.247360 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877629-2373-4fc3-a139-a2a6ff07b6b3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:46.250947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da5d8-357b-493e-bcc4-1300e87142c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:46.251573 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da5d8-357b-493e-bcc4-1300e87142c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:46.251849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da5d8-357b-493e-bcc4-1300e87142c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:46.252119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da5d8-357b-493e-bcc4-1300e87142c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:46.261002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da5d8-357b-493e-bcc4-1300e87142c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:46.262444 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4da5d8-357b-493e-bcc4-1300e87142c7 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:46.271467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1086/2165] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:46.352186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb7562-99b1-422d-80cc-93ccaa891624 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:46.361657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb7562-99b1-422d-80cc-93ccaa891624 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:46.365873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6781b-17d4-4ce3-adc6-87b1fbb7678c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:46.366501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6781b-17d4-4ce3-adc6-87b1fbb7678c service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:46.366777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6781b-17d4-4ce3-adc6-87b1fbb7678c service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:46.367046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6781b-17d4-4ce3-adc6-87b1fbb7678c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:46.420525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6781b-17d4-4ce3-adc6-87b1fbb7678c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:46.421985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6781b-17d4-4ce3-adc6-87b1fbb7678c service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:46.431315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1080/2166] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:46.661938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da5d8-357b-493e-bcc4-1300e87142c7 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:46.721033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da5d8-357b-493e-bcc4-1300e87142c7 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:46.726120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:46.726970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:46.727247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:46.727518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] PATH_INFO: `/v3/users/d2c24647fa2346fba74c22950e6a0eb7` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:46.728748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c24647fa2346fba74c22950e6a0eb7)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:46.730654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:46.775049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c24647fa2346fba74c22950e6a0eb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:46.783439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c24647fa2346fba74c22950e6a0eb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:46.791091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c24647fa2346fba74c22950e6a0eb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:46.802481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c24647fa2346fba74c22950e6a0eb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:46.803414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c24647fa2346fba74c22950e6a0eb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:46.811156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1087/2167] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:46 2022] DELETE /identity/v3/users/d2c24647fa2346fba74c22950e6a0eb7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:46.819004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85675-a02a-49cf-b329-883790951015 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:46.819291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85675-a02a-49cf-b329-883790951015 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:46.819568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85675-a02a-49cf-b329-883790951015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:46.855348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-51d85675-a02a-49cf-b329-883790951015 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:46.856710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-51d85675-a02a-49cf-b329-883790951015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:46.916821 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1081/2168] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:46.926675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:46.928228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:46.983624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea140-736c-4deb-81f2-60f156d22fd7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:46.987313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d356-ffed-4bf8-a04a-d8c9439c56e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:46.987972 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d356-ffed-4bf8-a04a-d8c9439c56e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:46.988254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d356-ffed-4bf8-a04a-d8c9439c56e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:46.988557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d356-ffed-4bf8-a04a-d8c9439c56e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:46.997783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868d356-ffed-4bf8-a04a-d8c9439c56e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:46.999249 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868d356-ffed-4bf8-a04a-d8c9439c56e9 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:47.009375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1088/2169] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:47.265651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85675-a02a-49cf-b329-883790951015 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:47.267161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-51d85675-a02a-49cf-b329-883790951015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:47.279506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85675-a02a-49cf-b329-883790951015 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:47.284009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:47.284913 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:47.285190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:47.285463 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] PATH_INFO: `/v3/projects/73ba08008e854149b5c1297717632ed8` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:47.286646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ba08008e854149b5c1297717632ed8)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:47.288564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:47.334394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ba08008e854149b5c1297717632ed8', 'request_id': 'req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.341350 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ba08008e854149b5c1297717632ed8', 'request_id': 'req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.346748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ba08008e854149b5c1297717632ed8', 'request_id': 'req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.358345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] The token cache is being invalidate because project 73ba08008e854149b5c1297717632ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:47.358628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.359253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.360795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1082/2170] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:47 2022] DELETE /identity/v3/projects/73ba08008e854149b5c1297717632ed8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:47.365761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d356-ffed-4bf8-a04a-d8c9439c56e9 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:47.375182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d356-ffed-4bf8-a04a-d8c9439c56e9 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:47.429367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:47.430227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:47.430505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:47.430776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] PATH_INFO: `/v3/users/eb80b02287b640aaa5d5d4bb4272e534` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:47.431984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb80b02287b640aaa5d5d4bb4272e534)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:47.433944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:47.478183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb80b02287b640aaa5d5d4bb4272e534'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.484776 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb80b02287b640aaa5d5d4bb4272e534'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.491824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb80b02287b640aaa5d5d4bb4272e534'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.503618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb80b02287b640aaa5d5d4bb4272e534'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.504255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9f9e04fd-93f9-4158-945b-20ae99746ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb80b02287b640aaa5d5d4bb4272e534'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.510045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1089/2171] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:47 2022] DELETE /identity/v3/users/eb80b02287b640aaa5d5d4bb4272e534 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:47.764100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:47.765762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:47.779213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac5ab5-7c6e-4a3d-8e47-434a2523f16b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:47.836516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:47.837384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:47.837665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:47.837943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] PATH_INFO: `/v3/projects/a8d73b3b91d84720b68f6358ffb52776` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:47.839187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d73b3b91d84720b68f6358ffb52776)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:47.841112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:47.888943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d73b3b91d84720b68f6358ffb52776', 'request_id': 'req-2c813993-9d36-4d2b-818c-ce44e0e84286'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.898633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d73b3b91d84720b68f6358ffb52776', 'request_id': 'req-2c813993-9d36-4d2b-818c-ce44e0e84286'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.904956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d73b3b91d84720b68f6358ffb52776', 'request_id': 'req-2c813993-9d36-4d2b-818c-ce44e0e84286'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.918315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] The token cache is being invalidate because project a8d73b3b91d84720b68f6358ffb52776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:47.918597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.919200 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2c813993-9d36-4d2b-818c-ce44e0e84286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:47.920770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1083/2172] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:47 2022] DELETE /identity/v3/projects/a8d73b3b91d84720b68f6358ffb52776 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:47.926966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f7de-ba1d-44de-a8b6-c2e01edc9a14 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:47.927256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f7de-ba1d-44de-a8b6-c2e01edc9a14 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:47.927538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f7de-ba1d-44de-a8b6-c2e01edc9a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:47.946152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a768f7de-ba1d-44de-a8b6-c2e01edc9a14 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:47.947346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a768f7de-ba1d-44de-a8b6-c2e01edc9a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:48.012192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1090/2173] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:48.020213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13457611-bd2b-499a-89dc-ec646b8135db None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.020579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13457611-bd2b-499a-89dc-ec646b8135db None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.020848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13457611-bd2b-499a-89dc-ec646b8135db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.040122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-13457611-bd2b-499a-89dc-ec646b8135db None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:48.041470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-13457611-bd2b-499a-89dc-ec646b8135db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:48.050698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1084/2174] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:48.054657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f7de-ba1d-44de-a8b6-c2e01edc9a14 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.064244 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f7de-ba1d-44de-a8b6-c2e01edc9a14 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.068731 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80b9ff-e69f-45f1-a248-59c0fdca43e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.069392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b9ff-e69f-45f1-a248-59c0fdca43e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.069669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b9ff-e69f-45f1-a248-59c0fdca43e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.069943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80b9ff-e69f-45f1-a248-59c0fdca43e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.070702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80b9ff-e69f-45f1-a248-59c0fdca43e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:48.071004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80b9ff-e69f-45f1-a248-59c0fdca43e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.072623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80b9ff-e69f-45f1-a248-59c0fdca43e2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.085035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1091/2175] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:41:48.089759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13457611-bd2b-499a-89dc-ec646b8135db None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.102258 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13457611-bd2b-499a-89dc-ec646b8135db None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.108513 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bb84a-2199-48ff-9745-8e40a9755b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.109409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb84a-2199-48ff-9745-8e40a9755b64 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.109862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb84a-2199-48ff-9745-8e40a9755b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.110310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3bb84a-2199-48ff-9745-8e40a9755b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.111406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bb84a-2199-48ff-9745-8e40a9755b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.114474 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3bb84a-2199-48ff-9745-8e40a9755b64 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.144888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1085/2176] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:48 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:48.146423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80b9ff-e69f-45f1-a248-59c0fdca43e2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.156278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80b9ff-e69f-45f1-a248-59c0fdca43e2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.213266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93f609-942a-4e2d-9037-83bdcb31dbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.213929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f609-942a-4e2d-9037-83bdcb31dbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.214205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f609-942a-4e2d-9037-83bdcb31dbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.214485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93f609-942a-4e2d-9037-83bdcb31dbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.215177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93f609-942a-4e2d-9037-83bdcb31dbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.217124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93f609-942a-4e2d-9037-83bdcb31dbd3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.237586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1092/2177] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:48 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:48.241592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bb84a-2199-48ff-9745-8e40a9755b64 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.251609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3bb84a-2199-48ff-9745-8e40a9755b64 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.256129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce10fc-c0e7-4e9b-b2eb-94fc8fa2638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.256811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce10fc-c0e7-4e9b-b2eb-94fc8fa2638e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.257106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce10fc-c0e7-4e9b-b2eb-94fc8fa2638e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.257360 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce10fc-c0e7-4e9b-b2eb-94fc8fa2638e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.258081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce10fc-c0e7-4e9b-b2eb-94fc8fa2638e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.259643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce10fc-c0e7-4e9b-b2eb-94fc8fa2638e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.270314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1086/2178] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:48.274102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93f609-942a-4e2d-9037-83bdcb31dbd3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.285851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93f609-942a-4e2d-9037-83bdcb31dbd3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.291110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad907e-dfae-43d8-bb28-c90edba56eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.291902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad907e-dfae-43d8-bb28-c90edba56eef admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.292181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad907e-dfae-43d8-bb28-c90edba56eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.292497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad907e-dfae-43d8-bb28-c90edba56eef admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.293363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad907e-dfae-43d8-bb28-c90edba56eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.295222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad907e-dfae-43d8-bb28-c90edba56eef admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.306610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1093/2179] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:48.310975 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce10fc-c0e7-4e9b-b2eb-94fc8fa2638e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.320744 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce10fc-c0e7-4e9b-b2eb-94fc8fa2638e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.325527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cf603-efd1-4995-903d-cc80edd50bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.326386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cf603-efd1-4995-903d-cc80edd50bba admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.326662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cf603-efd1-4995-903d-cc80edd50bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.326940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cf603-efd1-4995-903d-cc80edd50bba admin admin] PATH_INFO: `/v3/projects/a5ea0fd2d84a4eb08cb4c3cf39209c2d/users/19b853536120464b87606225a5dadb4c/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.342098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cf603-efd1-4995-903d-cc80edd50bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ea0fd2d84a4eb08cb4c3cf39209c2d, user_id=19b853536120464b87606225a5dadb4c, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.344749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cf603-efd1-4995-903d-cc80edd50bba admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.358798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1087/2180] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:48 2022] PUT /identity/v3/projects/a5ea0fd2d84a4eb08cb4c3cf39209c2d/users/19b853536120464b87606225a5dadb4c/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:48.370432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd492f2-131e-4bab-9ad0-6d32f2a34a05 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.371011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd492f2-131e-4bab-9ad0-6d32f2a34a05 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.371011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd492f2-131e-4bab-9ad0-6d32f2a34a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.397452 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7dd492f2-131e-4bab-9ad0-6d32f2a34a05 None None] MFA Rules not processed for user `19b853536120464b87606225a5dadb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:48.398647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7dd492f2-131e-4bab-9ad0-6d32f2a34a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:48.460272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1094/2181] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:48.464904 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cf603-efd1-4995-903d-cc80edd50bba admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.532894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cf603-efd1-4995-903d-cc80edd50bba admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.538095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2194bf9-cf0c-4c6b-99ca-ff8a48aab4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.538774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2194bf9-cf0c-4c6b-99ca-ff8a48aab4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.539053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2194bf9-cf0c-4c6b-99ca-ff8a48aab4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.539329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2194bf9-cf0c-4c6b-99ca-ff8a48aab4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.540042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2194bf9-cf0c-4c6b-99ca-ff8a48aab4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.541981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2194bf9-cf0c-4c6b-99ca-ff8a48aab4d4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.569457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1088/2182] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:48 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:48.571537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd492f2-131e-4bab-9ad0-6d32f2a34a05 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.585466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd492f2-131e-4bab-9ad0-6d32f2a34a05 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.646764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3307ab-fa8d-4ec4-bdd5-07cd04a046a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.647431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3307ab-fa8d-4ec4-bdd5-07cd04a046a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.647709 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3307ab-fa8d-4ec4-bdd5-07cd04a046a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.647981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3307ab-fa8d-4ec4-bdd5-07cd04a046a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.648713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3307ab-fa8d-4ec4-bdd5-07cd04a046a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.650633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3307ab-fa8d-4ec4-bdd5-07cd04a046a3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.673084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1095/2183] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:48 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:48.674325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2194bf9-cf0c-4c6b-99ca-ff8a48aab4d4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.689556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2194bf9-cf0c-4c6b-99ca-ff8a48aab4d4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.695150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87312660-6e2e-41c9-abd6-bd3be2316f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.695883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87312660-6e2e-41c9-abd6-bd3be2316f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.696294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87312660-6e2e-41c9-abd6-bd3be2316f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.696682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87312660-6e2e-41c9-abd6-bd3be2316f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.697525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87312660-6e2e-41c9-abd6-bd3be2316f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.699474 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87312660-6e2e-41c9-abd6-bd3be2316f00 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.710788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1089/2184] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:48.714954 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3307ab-fa8d-4ec4-bdd5-07cd04a046a3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.724670 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3307ab-fa8d-4ec4-bdd5-07cd04a046a3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.729321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cb303-4a48-4f03-97ac-bb5bb7708cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.729970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cb303-4a48-4f03-97ac-bb5bb7708cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.730248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cb303-4a48-4f03-97ac-bb5bb7708cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.730522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cb303-4a48-4f03-97ac-bb5bb7708cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.731257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cb303-4a48-4f03-97ac-bb5bb7708cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.732868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67cb303-4a48-4f03-97ac-bb5bb7708cb1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.742582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1096/2185] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:48.746732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87312660-6e2e-41c9-abd6-bd3be2316f00 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.757084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87312660-6e2e-41c9-abd6-bd3be2316f00 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:48.761765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9b860-395e-461c-a0dc-cac3aea32481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:48.762667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9b860-395e-461c-a0dc-cac3aea32481 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.762944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9b860-395e-461c-a0dc-cac3aea32481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.763215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9b860-395e-461c-a0dc-cac3aea32481 admin admin] PATH_INFO: `/v3/projects/240d70a6c8bb4d339341a8fa558858b4/users/3a00775c869845ac8535deb7cd9c6fbe/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.779015 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9b860-395e-461c-a0dc-cac3aea32481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=240d70a6c8bb4d339341a8fa558858b4, user_id=3a00775c869845ac8535deb7cd9c6fbe, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:48.781733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9b860-395e-461c-a0dc-cac3aea32481 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:48.795485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1090/2186] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:48 2022] PUT /identity/v3/projects/240d70a6c8bb4d339341a8fa558858b4/users/3a00775c869845ac8535deb7cd9c6fbe/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:48.806018 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a4b6-25b2-404a-ad25-adce89f6aa8b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:48.806384 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a4b6-25b2-404a-ad25-adce89f6aa8b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:48.806733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a4b6-25b2-404a-ad25-adce89f6aa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:48.836220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f037a4b6-25b2-404a-ad25-adce89f6aa8b None None] MFA Rules not processed for user `3a00775c869845ac8535deb7cd9c6fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:48.837818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f037a4b6-25b2-404a-ad25-adce89f6aa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:48.915228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1097/2187] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:48.919710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9b860-395e-461c-a0dc-cac3aea32481 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:48.996160 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9b860-395e-461c-a0dc-cac3aea32481 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:49.000910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b979-96d4-4dec-bb04-a5911d7b1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:49.001566 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b979-96d4-4dec-bb04-a5911d7b1332 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:49.001844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b979-96d4-4dec-bb04-a5911d7b1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:49.002123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b979-96d4-4dec-bb04-a5911d7b1332 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:49.002826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3b979-96d4-4dec-bb04-a5911d7b1332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:49.005780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3b979-96d4-4dec-bb04-a5911d7b1332 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:49.034017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1091/2188] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:48 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:49.037497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037a4b6-25b2-404a-ad25-adce89f6aa8b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:49.048708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037a4b6-25b2-404a-ad25-adce89f6aa8b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:49.114295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea76c41-3295-431b-8306-5deccfe263f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:49.115023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea76c41-3295-431b-8306-5deccfe263f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:49.115302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea76c41-3295-431b-8306-5deccfe263f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:49.115570 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea76c41-3295-431b-8306-5deccfe263f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:49.116306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea76c41-3295-431b-8306-5deccfe263f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:49.118382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea76c41-3295-431b-8306-5deccfe263f2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:49.142425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1098/2189] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:49 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:49.144875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b979-96d4-4dec-bb04-a5911d7b1332 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:49.155531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b979-96d4-4dec-bb04-a5911d7b1332 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:49.160372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c13b00-d677-4967-9d7c-2a23c1b46356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:49.161028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c13b00-d677-4967-9d7c-2a23c1b46356 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:49.161307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c13b00-d677-4967-9d7c-2a23c1b46356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:49.161583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c13b00-d677-4967-9d7c-2a23c1b46356 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:49.162371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c13b00-d677-4967-9d7c-2a23c1b46356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:49.164029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c13b00-d677-4967-9d7c-2a23c1b46356 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:49.175827 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1092/2190] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:49.180642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea76c41-3295-431b-8306-5deccfe263f2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:49.191882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea76c41-3295-431b-8306-5deccfe263f2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:49.197719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac5e3e-18bb-4036-b269-2a0ddccd00fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:49.198860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac5e3e-18bb-4036-b269-2a0ddccd00fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:49.199141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac5e3e-18bb-4036-b269-2a0ddccd00fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:49.199432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac5e3e-18bb-4036-b269-2a0ddccd00fd admin admin] PATH_INFO: `/v3/projects/c32d470761f34023b5443714972087e9/users/7e08a28c72a148c19cfd5f6f902c3bd3/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:49.218662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac5e3e-18bb-4036-b269-2a0ddccd00fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32d470761f34023b5443714972087e9, user_id=7e08a28c72a148c19cfd5f6f902c3bd3, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:49.222617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac5e3e-18bb-4036-b269-2a0ddccd00fd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:49.241999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1099/2191] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:49 2022] PUT /identity/v3/projects/c32d470761f34023b5443714972087e9/users/7e08a28c72a148c19cfd5f6f902c3bd3/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:49.243006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c13b00-d677-4967-9d7c-2a23c1b46356 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:49.255515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c13b00-d677-4967-9d7c-2a23c1b46356 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:49.316912 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa405e8a-3783-4b6f-8c16-7362efbfad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:49.317574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405e8a-3783-4b6f-8c16-7362efbfad3f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:49.317880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405e8a-3783-4b6f-8c16-7362efbfad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:49.318155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405e8a-3783-4b6f-8c16-7362efbfad3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:49.318939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa405e8a-3783-4b6f-8c16-7362efbfad3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:49.320585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa405e8a-3783-4b6f-8c16-7362efbfad3f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:49.336600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1093/2192] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:41:49.338422 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac5e3e-18bb-4036-b269-2a0ddccd00fd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:49.350181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac5e3e-18bb-4036-b269-2a0ddccd00fd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:49.355391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361ad28-8f3d-4e17-9562-682d5a877ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:49.356272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361ad28-8f3d-4e17-9562-682d5a877ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:49.356732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361ad28-8f3d-4e17-9562-682d5a877ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:49.357005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361ad28-8f3d-4e17-9562-682d5a877ee0 admin admin] PATH_INFO: `/v3/projects/c32d470761f34023b5443714972087e9/users/7e08a28c72a148c19cfd5f6f902c3bd3/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:49.359001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361ad28-8f3d-4e17-9562-682d5a877ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c32d470761f34023b5443714972087e9, user_id=7e08a28c72a148c19cfd5f6f902c3bd3, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:49.361653 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361ad28-8f3d-4e17-9562-682d5a877ee0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:49.372902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1100/2193] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:41:49 2022] PUT /identity/v3/projects/c32d470761f34023b5443714972087e9/users/7e08a28c72a148c19cfd5f6f902c3bd3/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:49.384940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e1dc6-bde3-49f5-baa1-7dd2dc888e6e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:49.385231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e1dc6-bde3-49f5-baa1-7dd2dc888e6e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:49.385514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e1dc6-bde3-49f5-baa1-7dd2dc888e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:49.411837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-457e1dc6-bde3-49f5-baa1-7dd2dc888e6e None None] MFA Rules not processed for user `7e08a28c72a148c19cfd5f6f902c3bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:49.413056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-457e1dc6-bde3-49f5-baa1-7dd2dc888e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:49.497918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1094/2194] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:49.510980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361ad28-8f3d-4e17-9562-682d5a877ee0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:49.512837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5361ad28-8f3d-4e17-9562-682d5a877ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:49.568623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361ad28-8f3d-4e17-9562-682d5a877ee0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:49.572214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89e95d-a1f5-4e48-a213-6efd3a7e3317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:49.573134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89e95d-a1f5-4e48-a213-6efd3a7e3317 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:49.573538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89e95d-a1f5-4e48-a213-6efd3a7e3317 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:49.573680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89e95d-a1f5-4e48-a213-6efd3a7e3317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:49.628546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89e95d-a1f5-4e48-a213-6efd3a7e3317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:49.629985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89e95d-a1f5-4e48-a213-6efd3a7e3317 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:49.638740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1101/2195] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:54.256886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e1dc6-bde3-49f5-baa1-7dd2dc888e6e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:54.266773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e1dc6-bde3-49f5-baa1-7dd2dc888e6e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:54.273662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49beed8-25ab-4453-894f-4c08ecdee485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:54.274422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49beed8-25ab-4453-894f-4c08ecdee485 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:54.274904 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49beed8-25ab-4453-894f-4c08ecdee485 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:54.275151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49beed8-25ab-4453-894f-4c08ecdee485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:54.335163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49beed8-25ab-4453-894f-4c08ecdee485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:54.336746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49beed8-25ab-4453-894f-4c08ecdee485 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:54.346034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1095/2196] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:54.825530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89e95d-a1f5-4e48-a213-6efd3a7e3317 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:54.827021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1d89e95d-a1f5-4e48-a213-6efd3a7e3317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:54.894174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89e95d-a1f5-4e48-a213-6efd3a7e3317 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:54.896867 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49beed8-25ab-4453-894f-4c08ecdee485 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:54.898313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b49beed8-25ab-4453-894f-4c08ecdee485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:54.898896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:54.899754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:54.900022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:54.900290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] PATH_INFO: `/v3/users/109a0c4d2840471bad9d4985927d06ab` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:54.901499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109a0c4d2840471bad9d4985927d06ab)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:54.903400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:54.909963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49beed8-25ab-4453-894f-4c08ecdee485 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:54.913530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5db9c4-6a73-4d0c-9fa6-1c6210d80207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:54.914162 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db9c4-6a73-4d0c-9fa6-1c6210d80207 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:54.914439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db9c4-6a73-4d0c-9fa6-1c6210d80207 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:54.914735 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db9c4-6a73-4d0c-9fa6-1c6210d80207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:54.923949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5db9c4-6a73-4d0c-9fa6-1c6210d80207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:54.926036 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5db9c4-6a73-4d0c-9fa6-1c6210d80207 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:54.936925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1096/2197] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:41:54.953745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109a0c4d2840471bad9d4985927d06ab'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:54.962975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109a0c4d2840471bad9d4985927d06ab'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:54.972226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109a0c4d2840471bad9d4985927d06ab'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:54.991982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109a0c4d2840471bad9d4985927d06ab'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:54.992181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109a0c4d2840471bad9d4985927d06ab'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:55.001944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1102/2198] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:54 2022] DELETE /identity/v3/users/109a0c4d2840471bad9d4985927d06ab => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:55.004682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8874e-3222-40a4-9941-2ec0e4c21a1c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:55.005190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8874e-3222-40a4-9941-2ec0e4c21a1c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:55.005465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8874e-3222-40a4-9941-2ec0e4c21a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:55.023590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-97f8874e-3222-40a4-9941-2ec0e4c21a1c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:55.024825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-97f8874e-3222-40a4-9941-2ec0e4c21a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:55.088276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1097/2199] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:41:55.097976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:55.099398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:55.161922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0955c-7e00-421c-bf19-3c5f65562a50 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:55.165723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2e1ee-fe37-4682-9aa3-c1db0d635f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:55.166362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2e1ee-fe37-4682-9aa3-c1db0d635f60 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:55.166641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2e1ee-fe37-4682-9aa3-c1db0d635f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:55.166914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2e1ee-fe37-4682-9aa3-c1db0d635f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:55.176474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2e1ee-fe37-4682-9aa3-c1db0d635f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:55.177994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2e1ee-fe37-4682-9aa3-c1db0d635f60 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:55.187895 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1103/2200] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:55.464035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8874e-3222-40a4-9941-2ec0e4c21a1c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:55.466116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-97f8874e-3222-40a4-9941-2ec0e4c21a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:55.485134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8874e-3222-40a4-9941-2ec0e4c21a1c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:55.490651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:55.491519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:55.491805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:55.492079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] PATH_INFO: `/v3/projects/277266a3399f4ad48cef5966ae2987c8` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:55.493333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=277266a3399f4ad48cef5966ae2987c8)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:55.495269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:55.541379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277266a3399f4ad48cef5966ae2987c8', 'request_id': 'req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:55.547687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277266a3399f4ad48cef5966ae2987c8', 'request_id': 'req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:55.553840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277266a3399f4ad48cef5966ae2987c8', 'request_id': 'req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:55.565518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] The token cache is being invalidate because project 277266a3399f4ad48cef5966ae2987c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:55.565800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:55.566413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:55.567955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1098/2201] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:55 2022] DELETE /identity/v3/projects/277266a3399f4ad48cef5966ae2987c8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:58.778076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2e1ee-fe37-4682-9aa3-c1db0d635f60 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:58.779507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-19a2e1ee-fe37-4682-9aa3-c1db0d635f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:58.791016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:58.792550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:58.792958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2e1ee-fe37-4682-9aa3-c1db0d635f60 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:58.849575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:58.850433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:58.850710 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:58.850980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] PATH_INFO: `/v3/users/b88790a080ea48ec89862bde682e550a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:58.852538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b88790a080ea48ec89862bde682e550a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:58.854497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:58.856194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b03ed6-7580-47f7-8ed3-4beb0a5105fc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:58.860819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:58.861707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:58.861986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:58.862260 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] PATH_INFO: `/v3/users/19b853536120464b87606225a5dadb4c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:58.863678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b853536120464b87606225a5dadb4c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:58.865626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:58.901107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b88790a080ea48ec89862bde682e550a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.912478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b853536120464b87606225a5dadb4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.913451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b88790a080ea48ec89862bde682e550a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.921705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b853536120464b87606225a5dadb4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.922143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b88790a080ea48ec89862bde682e550a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.934013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b853536120464b87606225a5dadb4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.934532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b88790a080ea48ec89862bde682e550a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.934764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b853536120464b87606225a5dadb4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.935403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c763d6ea-dd20-4af0-8e08-378f4417411e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b88790a080ea48ec89862bde682e550a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.942451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1104/2202] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:58 2022] DELETE /identity/v3/users/b88790a080ea48ec89862bde682e550a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:58.943313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0153318-e6af-4640-b8c0-a581c0d06de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b853536120464b87606225a5dadb4c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:58.946861 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ff03f-c005-4def-8b02-67bc603175ea None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:58.947146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ff03f-c005-4def-8b02-67bc603175ea None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:58.947448 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ff03f-c005-4def-8b02-67bc603175ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:58.949804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1099/2203] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:58 2022] DELETE /identity/v3/users/19b853536120464b87606225a5dadb4c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:58.953942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21004e1-009b-4529-af3b-23f8d7df7182 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:58.954229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21004e1-009b-4529-af3b-23f8d7df7182 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:58.954513 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21004e1-009b-4529-af3b-23f8d7df7182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:58.967290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-642ff03f-c005-4def-8b02-67bc603175ea None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:58.968690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-642ff03f-c005-4def-8b02-67bc603175ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:58.971884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d21004e1-009b-4529-af3b-23f8d7df7182 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:58.973113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d21004e1-009b-4529-af3b-23f8d7df7182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:59.028675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1105/2204] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:59.032676 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1100/2205] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:59.041289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ff03f-c005-4def-8b02-67bc603175ea None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:59.041694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21004e1-009b-4529-af3b-23f8d7df7182 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:59.042701 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-642ff03f-c005-4def-8b02-67bc603175ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:59.043018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d21004e1-009b-4529-af3b-23f8d7df7182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:59.099990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ff03f-c005-4def-8b02-67bc603175ea None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:59.101467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21004e1-009b-4529-af3b-23f8d7df7182 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:59.103972 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d0253-b931-4b43-b3f2-f4404d662ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:59.104677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d0253-b931-4b43-b3f2-f4404d662ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.104983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d0253-b931-4b43-b3f2-f4404d662ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.105408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d0253-b931-4b43-b3f2-f4404d662ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.106777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae934c3-9fda-4a93-9af2-e9456fd849dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:59.107438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae934c3-9fda-4a93-9af2-e9456fd849dd service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.107721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae934c3-9fda-4a93-9af2-e9456fd849dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.107999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae934c3-9fda-4a93-9af2-e9456fd849dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.115310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d0253-b931-4b43-b3f2-f4404d662ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:59.116754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d0253-b931-4b43-b3f2-f4404d662ab8 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:59.117301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae934c3-9fda-4a93-9af2-e9456fd849dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:59.118726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae934c3-9fda-4a93-9af2-e9456fd849dd service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:59.126050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1106/2206] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:59.132409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1101/2207] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:41:59.408206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d0253-b931-4b43-b3f2-f4404d662ab8 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:59.410880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4a3d0253-b931-4b43-b3f2-f4404d662ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:59.423518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae934c3-9fda-4a93-9af2-e9456fd849dd service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:59.425008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2ae934c3-9fda-4a93-9af2-e9456fd849dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:59.440883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d0253-b931-4b43-b3f2-f4404d662ab8 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:59.453082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae934c3-9fda-4a93-9af2-e9456fd849dd service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:59.459859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:59.460790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:59.460940 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.461206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.461483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] PATH_INFO: `/v3/projects/a5ea0fd2d84a4eb08cb4c3cf39209c2d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.461677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.461956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.462228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] PATH_INFO: `/v3/projects/3fc0370b223844be80a680de68d7980d` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.463602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc0370b223844be80a680de68d7980d)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:59.465575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:59.468439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ea0fd2d84a4eb08cb4c3cf39209c2d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:59.470363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:59.525578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ea0fd2d84a4eb08cb4c3cf39209c2d', 'request_id': 'req-f5545483-8616-4927-97d1-18d2752081e3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.527348 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc0370b223844be80a680de68d7980d', 'request_id': 'req-91c1998b-1b60-4916-b9e6-93e8257d307a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.531842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ea0fd2d84a4eb08cb4c3cf39209c2d', 'request_id': 'req-f5545483-8616-4927-97d1-18d2752081e3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.533474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc0370b223844be80a680de68d7980d', 'request_id': 'req-91c1998b-1b60-4916-b9e6-93e8257d307a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.537837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ea0fd2d84a4eb08cb4c3cf39209c2d', 'request_id': 'req-f5545483-8616-4927-97d1-18d2752081e3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.541717 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc0370b223844be80a680de68d7980d', 'request_id': 'req-91c1998b-1b60-4916-b9e6-93e8257d307a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.551732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] The token cache is being invalidate because project a5ea0fd2d84a4eb08cb4c3cf39209c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:59.552070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.552741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.554136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] The token cache is being invalidate because project 3fc0370b223844be80a680de68d7980d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:41:59.554630 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1102/2208] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:59 2022] DELETE /identity/v3/projects/a5ea0fd2d84a4eb08cb4c3cf39209c2d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:59.554740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.555408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-91c1998b-1b60-4916-b9e6-93e8257d307a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.557462 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1107/2209] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:41:59 2022] DELETE /identity/v3/projects/3fc0370b223844be80a680de68d7980d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:41:59.562684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:59.563442 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bf71a-b96b-4952-af5f-9a0564caba94 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.563894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bf71a-b96b-4952-af5f-9a0564caba94 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.564427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:59.564617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bf71a-b96b-4952-af5f-9a0564caba94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.584876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0f9bf71a-b96b-4952-af5f-9a0564caba94 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:59.586054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0f9bf71a-b96b-4952-af5f-9a0564caba94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:59.636181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545483-8616-4927-97d1-18d2752081e3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:59.645856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1108/2210] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:59.653801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488859a-e8c1-476c-8104-bb89eeed98c0 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.654090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488859a-e8c1-476c-8104-bb89eeed98c0 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.654363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488859a-e8c1-476c-8104-bb89eeed98c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.671703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2488859a-e8c1-476c-8104-bb89eeed98c0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:41:59.678239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2488859a-e8c1-476c-8104-bb89eeed98c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:59.683438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1109/2211] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:41:59.687480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488859a-e8c1-476c-8104-bb89eeed98c0 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:59.692759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:59.693634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.693911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.694184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] PATH_INFO: `/v3/users/3a00775c869845ac8535deb7cd9c6fbe` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.695415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a00775c869845ac8535deb7cd9c6fbe)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:59.698021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:59.698129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488859a-e8c1-476c-8104-bb89eeed98c0 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:59.703073 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f50f-971f-4b2a-82a0-fd5df2f8fba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:59.703789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f50f-971f-4b2a-82a0-fd5df2f8fba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.704136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f50f-971f-4b2a-82a0-fd5df2f8fba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.704514 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f50f-971f-4b2a-82a0-fd5df2f8fba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.705317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f50f-971f-4b2a-82a0-fd5df2f8fba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:41:59.705686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f50f-971f-4b2a-82a0-fd5df2f8fba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:59.707408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f50f-971f-4b2a-82a0-fd5df2f8fba8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:59.725379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1110/2212] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:41:59.728426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f50f-971f-4b2a-82a0-fd5df2f8fba8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:59.744556 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f50f-971f-4b2a-82a0-fd5df2f8fba8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:59.753862 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f259fc6-c0a0-4f85-94fc-54d3dd3b4994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:59.754440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259fc6-c0a0-4f85-94fc-54d3dd3b4994 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.754723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259fc6-c0a0-4f85-94fc-54d3dd3b4994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.754996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259fc6-c0a0-4f85-94fc-54d3dd3b4994 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.755736 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f259fc6-c0a0-4f85-94fc-54d3dd3b4994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:59.758015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f259fc6-c0a0-4f85-94fc-54d3dd3b4994 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:59.762997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a00775c869845ac8535deb7cd9c6fbe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.770340 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a00775c869845ac8535deb7cd9c6fbe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.785311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a00775c869845ac8535deb7cd9c6fbe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.786003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a00775c869845ac8535deb7cd9c6fbe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.790332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1111/2213] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:41:59 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:41:59.793572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f259fc6-c0a0-4f85-94fc-54d3dd3b4994 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:59.794816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a00775c869845ac8535deb7cd9c6fbe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:41:59.802394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1103/2214] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:41:59 2022] DELETE /identity/v3/users/3a00775c869845ac8535deb7cd9c6fbe => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:41:59.873837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f259fc6-c0a0-4f85-94fc-54d3dd3b4994 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:59.932781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dd93b-7161-4cbe-90ae-9c5c16ba57ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:59.933620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dd93b-7161-4cbe-90ae-9c5c16ba57ad admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.934005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dd93b-7161-4cbe-90ae-9c5c16ba57ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.934381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dd93b-7161-4cbe-90ae-9c5c16ba57ad admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.935231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dd93b-7161-4cbe-90ae-9c5c16ba57ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:59.937310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dd93b-7161-4cbe-90ae-9c5c16ba57ad admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:41:59.967574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1112/2215] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:41:59 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:41:59.968849 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:41:59.970305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:41:59.988878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c08a-0721-496b-96c8-6a622d77d9e3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:41:59.993728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ccc56-a569-4848-88a5-2190c9047acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:41:59.994499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ccc56-a569-4848-88a5-2190c9047acd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:41:59.995023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ccc56-a569-4848-88a5-2190c9047acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:41:59.995372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ccc56-a569-4848-88a5-2190c9047acd admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:41:59.996116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ccc56-a569-4848-88a5-2190c9047acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:41:59.997743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ccc56-a569-4848-88a5-2190c9047acd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:00.008689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1104/2216] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:00.012718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dd93b-7161-4cbe-90ae-9c5c16ba57ad admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:00.023887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dd93b-7161-4cbe-90ae-9c5c16ba57ad admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:00.028744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b14054-7ea5-47bb-aa61-584e8af70dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:00.029403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b14054-7ea5-47bb-aa61-584e8af70dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:00.029714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b14054-7ea5-47bb-aa61-584e8af70dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:00.029986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b14054-7ea5-47bb-aa61-584e8af70dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:00.030886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b14054-7ea5-47bb-aa61-584e8af70dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:00.032522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b14054-7ea5-47bb-aa61-584e8af70dcd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:00.043690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1113/2217] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:00.048051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ccc56-a569-4848-88a5-2190c9047acd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:00.058421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ccc56-a569-4848-88a5-2190c9047acd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:00.063823 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc1995-9360-4ea7-b1a6-231c5ab67ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:00.064738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc1995-9360-4ea7-b1a6-231c5ab67ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:00.065065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc1995-9360-4ea7-b1a6-231c5ab67ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:00.065346 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc1995-9360-4ea7-b1a6-231c5ab67ed4 admin admin] PATH_INFO: `/v3/projects/3e1d85b509b147f3ac9266617fc9bbe1/users/e94f610fab5d4f55a321d921b31b17fe/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:00.085373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc1995-9360-4ea7-b1a6-231c5ab67ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1d85b509b147f3ac9266617fc9bbe1, user_id=e94f610fab5d4f55a321d921b31b17fe, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:00.088881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc1995-9360-4ea7-b1a6-231c5ab67ed4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:00.091297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b14054-7ea5-47bb-aa61-584e8af70dcd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:00.098513 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-94b14054-7ea5-47bb-aa61-584e8af70dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:00.109870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1105/2218] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:00 2022] PUT /identity/v3/projects/3e1d85b509b147f3ac9266617fc9bbe1/users/e94f610fab5d4f55a321d921b31b17fe/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:00.114210 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b14054-7ea5-47bb-aa61-584e8af70dcd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:00.120811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24194e4-73d0-4a09-8b7d-85528155a55c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:00.121180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24194e4-73d0-4a09-8b7d-85528155a55c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:00.121536 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24194e4-73d0-4a09-8b7d-85528155a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:00.148270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b24194e4-73d0-4a09-8b7d-85528155a55c None None] MFA Rules not processed for user `e94f610fab5d4f55a321d921b31b17fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:00.149630 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b24194e4-73d0-4a09-8b7d-85528155a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:00.172835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:00.173616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:00.173899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:00.174178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] PATH_INFO: `/v3/projects/240d70a6c8bb4d339341a8fa558858b4` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:00.175641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] RBAC: Authorizing `identity:delete_project(project_id=240d70a6c8bb4d339341a8fa558858b4)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:00.177933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:00.219654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1106/2219] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:42:00.229887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24194e4-73d0-4a09-8b7d-85528155a55c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:00.231265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b24194e4-73d0-4a09-8b7d-85528155a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:00.232403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240d70a6c8bb4d339341a8fa558858b4', 'request_id': 'req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.238503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240d70a6c8bb4d339341a8fa558858b4', 'request_id': 'req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.245419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240d70a6c8bb4d339341a8fa558858b4', 'request_id': 'req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.255914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] The token cache is being invalidate because project 240d70a6c8bb4d339341a8fa558858b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:42:00.256201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.256875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.258435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1114/2220] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:42:00 2022] DELETE /identity/v3/projects/240d70a6c8bb4d339341a8fa558858b4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:42:00.262483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:00.263831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:00.288188 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24194e4-73d0-4a09-8b7d-85528155a55c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:00.331279 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb26c2-c475-44e2-9eb9-d5a6943eb97b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:00.337355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:00.338214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:00.338485 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:00.338751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] PATH_INFO: `/v3/users/7e08a28c72a148c19cfd5f6f902c3bd3` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:00.339981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e08a28c72a148c19cfd5f6f902c3bd3)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:00.341929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:00.344243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef3c9-2d26-488f-8ef1-113d746c2b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:00.344923 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef3c9-2d26-488f-8ef1-113d746c2b68 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:00.345207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef3c9-2d26-488f-8ef1-113d746c2b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:00.345485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef3c9-2d26-488f-8ef1-113d746c2b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:00.347897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-303ef3c9-2d26-488f-8ef1-113d746c2b68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:00.395435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e08a28c72a148c19cfd5f6f902c3bd3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.403726 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e08a28c72a148c19cfd5f6f902c3bd3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.412138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e08a28c72a148c19cfd5f6f902c3bd3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.417248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef3c9-2d26-488f-8ef1-113d746c2b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:00.418732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef3c9-2d26-488f-8ef1-113d746c2b68 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:00.424019 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e08a28c72a148c19cfd5f6f902c3bd3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.424666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-374f7659-fa94-4777-83a7-bbf5f3c8f4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e08a28c72a148c19cfd5f6f902c3bd3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.428076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1107/2221] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:42:00.430754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1115/2222] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:42:00 2022] DELETE /identity/v3/users/7e08a28c72a148c19cfd5f6f902c3bd3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:42:00.721521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef3c9-2d26-488f-8ef1-113d746c2b68 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:00.733935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef3c9-2d26-488f-8ef1-113d746c2b68 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:00.797678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:00.798692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:00.799068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:00.799438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] PATH_INFO: `/v3/projects/c32d470761f34023b5443714972087e9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:00.801038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c32d470761f34023b5443714972087e9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:00.803215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:00.866079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c32d470761f34023b5443714972087e9', 'request_id': 'req-29badade-fa3f-4d16-9aee-82307a441eec'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.872790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c32d470761f34023b5443714972087e9', 'request_id': 'req-29badade-fa3f-4d16-9aee-82307a441eec'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.879029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c32d470761f34023b5443714972087e9', 'request_id': 'req-29badade-fa3f-4d16-9aee-82307a441eec'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.891107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] The token cache is being invalidate because project c32d470761f34023b5443714972087e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:42:00.891414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.891995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-29badade-fa3f-4d16-9aee-82307a441eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:00.893565 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1108/2223] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:42:00 2022] DELETE /identity/v3/projects/c32d470761f34023b5443714972087e9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:00.899201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d75b0-abec-4059-b3c6-8eb1fbb53ad1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:00.899658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d75b0-abec-4059-b3c6-8eb1fbb53ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:00.899768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d75b0-abec-4059-b3c6-8eb1fbb53ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:00.918021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d63d75b0-abec-4059-b3c6-8eb1fbb53ad1 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:00.919233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d63d75b0-abec-4059-b3c6-8eb1fbb53ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:00.980546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1116/2224] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:00.989118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c379e-e12c-433e-b2c2-26d6e1c9e04b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:00.989477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c379e-e12c-433e-b2c2-26d6e1c9e04b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:00.989850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c379e-e12c-433e-b2c2-26d6e1c9e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:01.009110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fe3c379e-e12c-433e-b2c2-26d6e1c9e04b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:01.010571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fe3c379e-e12c-433e-b2c2-26d6e1c9e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:01.020152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1109/2225] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:01.024428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d75b0-abec-4059-b3c6-8eb1fbb53ad1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:01.034185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d75b0-abec-4059-b3c6-8eb1fbb53ad1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:01.039375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e919c-dcbd-4e5b-b27d-f963dbbb326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:01.040011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e919c-dcbd-4e5b-b27d-f963dbbb326d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:01.040285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e919c-dcbd-4e5b-b27d-f963dbbb326d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:01.040590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e919c-dcbd-4e5b-b27d-f963dbbb326d admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:01.041317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e919c-dcbd-4e5b-b27d-f963dbbb326d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:42:01.041618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e919c-dcbd-4e5b-b27d-f963dbbb326d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:01.043193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e919c-dcbd-4e5b-b27d-f963dbbb326d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:01.054407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1117/2226] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:42:01.058633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c379e-e12c-433e-b2c2-26d6e1c9e04b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:01.067777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c379e-e12c-433e-b2c2-26d6e1c9e04b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:01.072407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c17c3-aa57-4d81-a7e3-062b0920a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:01.073311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c17c3-aa57-4d81-a7e3-062b0920a57e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:01.073588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c17c3-aa57-4d81-a7e3-062b0920a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:01.073859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c17c3-aa57-4d81-a7e3-062b0920a57e admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:01.074564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c17c3-aa57-4d81-a7e3-062b0920a57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:01.076477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c17c3-aa57-4d81-a7e3-062b0920a57e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:01.102068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1110/2227] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:42:01 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:01.106176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e919c-dcbd-4e5b-b27d-f963dbbb326d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:01.118144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e919c-dcbd-4e5b-b27d-f963dbbb326d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:01.171467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e69009-6838-4608-9993-0554fd5a1059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:01.172125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e69009-6838-4608-9993-0554fd5a1059 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:01.172433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e69009-6838-4608-9993-0554fd5a1059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:01.172712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e69009-6838-4608-9993-0554fd5a1059 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:01.173404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e69009-6838-4608-9993-0554fd5a1059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:01.175376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e69009-6838-4608-9993-0554fd5a1059 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:01.194711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1118/2228] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:42:01 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:01.199225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c17c3-aa57-4d81-a7e3-062b0920a57e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:01.210248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c17c3-aa57-4d81-a7e3-062b0920a57e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:01.214795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89840d76-d62d-4d74-b6e0-e9815262075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:01.215448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89840d76-d62d-4d74-b6e0-e9815262075d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:01.215728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89840d76-d62d-4d74-b6e0-e9815262075d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:01.216002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89840d76-d62d-4d74-b6e0-e9815262075d admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:01.216763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89840d76-d62d-4d74-b6e0-e9815262075d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:01.218346 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89840d76-d62d-4d74-b6e0-e9815262075d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:01.228758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1111/2229] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:01.232559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e69009-6838-4608-9993-0554fd5a1059 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:01.242265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e69009-6838-4608-9993-0554fd5a1059 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:01.246774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb34727-d602-406a-b301-269634c5c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:01.247408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb34727-d602-406a-b301-269634c5c867 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:01.247687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb34727-d602-406a-b301-269634c5c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:01.247960 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb34727-d602-406a-b301-269634c5c867 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:01.248728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb34727-d602-406a-b301-269634c5c867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:01.250311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb34727-d602-406a-b301-269634c5c867 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:01.260482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1119/2230] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:01.264291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89840d76-d62d-4d74-b6e0-e9815262075d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:01.274493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89840d76-d62d-4d74-b6e0-e9815262075d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:01.279109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272e49c-ff19-4499-9c6c-944e8a5284b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:01.279958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e49c-ff19-4499-9c6c-944e8a5284b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:01.280239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e49c-ff19-4499-9c6c-944e8a5284b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:01.280539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272e49c-ff19-4499-9c6c-944e8a5284b1 admin admin] PATH_INFO: `/v3/projects/389892796f3c4135a8d442afe846612a/users/9ba5c9aad52e4bfebae6958009e2f32f/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:01.295342 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272e49c-ff19-4499-9c6c-944e8a5284b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389892796f3c4135a8d442afe846612a, user_id=9ba5c9aad52e4bfebae6958009e2f32f, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:01.297985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272e49c-ff19-4499-9c6c-944e8a5284b1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:01.311249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1112/2231] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:01 2022] PUT /identity/v3/projects/389892796f3c4135a8d442afe846612a/users/9ba5c9aad52e4bfebae6958009e2f32f/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:01.316940 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf9e8d-d2f3-4056-9338-8db8a98ff370 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:01.317231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf9e8d-d2f3-4056-9338-8db8a98ff370 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:01.317555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf9e8d-d2f3-4056-9338-8db8a98ff370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:01.336087 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8edf9e8d-d2f3-4056-9338-8db8a98ff370 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:01.337313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8edf9e8d-d2f3-4056-9338-8db8a98ff370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:01.399708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1120/2232] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:42:01.409238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272e49c-ff19-4499-9c6c-944e8a5284b1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:01.411440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6272e49c-ff19-4499-9c6c-944e8a5284b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:01.468510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272e49c-ff19-4499-9c6c-944e8a5284b1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:01.472599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff349a4a-a66f-4e67-9cd5-75ab596485c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:01.473237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff349a4a-a66f-4e67-9cd5-75ab596485c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:01.473519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff349a4a-a66f-4e67-9cd5-75ab596485c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:01.473795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff349a4a-a66f-4e67-9cd5-75ab596485c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:01.483171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff349a4a-a66f-4e67-9cd5-75ab596485c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:01.484637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff349a4a-a66f-4e67-9cd5-75ab596485c2 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:01.495175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1113/2233] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:02.173229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573e96-e97d-42c9-a110-ab4be955a3f4 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:02.174085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573e96-e97d-42c9-a110-ab4be955a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:02.174546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573e96-e97d-42c9-a110-ab4be955a3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:02.213196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1a573e96-e97d-42c9-a110-ab4be955a3f4 None None] MFA Rules not processed for user `9ba5c9aad52e4bfebae6958009e2f32f`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:02.214728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1a573e96-e97d-42c9-a110-ab4be955a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:02.315310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1121/2234] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:02.325254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff349a4a-a66f-4e67-9cd5-75ab596485c2 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:02.326682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ff349a4a-a66f-4e67-9cd5-75ab596485c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:02.385770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff349a4a-a66f-4e67-9cd5-75ab596485c2 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:02.389469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726cac6-200e-46fe-9237-b8973a7900d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:02.390111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726cac6-200e-46fe-9237-b8973a7900d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:02.390420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726cac6-200e-46fe-9237-b8973a7900d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:02.390700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726cac6-200e-46fe-9237-b8973a7900d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:02.399344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726cac6-200e-46fe-9237-b8973a7900d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:02.400851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726cac6-200e-46fe-9237-b8973a7900d3 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:02.410133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1114/2235] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:03.762424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0397f-a790-45f8-97e7-f551f969b822 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:03.762916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0397f-a790-45f8-97e7-f551f969b822 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:03.763028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0397f-a790-45f8-97e7-f551f969b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:03.781167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ade0397f-a790-45f8-97e7-f551f969b822 None None] MFA Rules not processed for user `9ba5c9aad52e4bfebae6958009e2f32f`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:03.782354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ade0397f-a790-45f8-97e7-f551f969b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:03.789482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1122/2236] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:12.502531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726cac6-200e-46fe-9237-b8973a7900d3 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:12.504430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6726cac6-200e-46fe-9237-b8973a7900d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:12.520278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726cac6-200e-46fe-9237-b8973a7900d3 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:12.525616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:12.526949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:12.526949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:12.527091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] PATH_INFO: `/v3/users/e94f610fab5d4f55a321d921b31b17fe` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:12.528388 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94f610fab5d4f55a321d921b31b17fe)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:12.530445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:12.580633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94f610fab5d4f55a321d921b31b17fe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:12.588395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94f610fab5d4f55a321d921b31b17fe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:12.599931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94f610fab5d4f55a321d921b31b17fe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:12.600755 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94f610fab5d4f55a321d921b31b17fe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:12.609163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94f610fab5d4f55a321d921b31b17fe'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:12.615240 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1115/2237] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:42:12 2022] DELETE /identity/v3/users/e94f610fab5d4f55a321d921b31b17fe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:12.619788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d54367-492b-4582-b4dc-52ee75a34c2e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:12.620243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d54367-492b-4582-b4dc-52ee75a34c2e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:12.620333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d54367-492b-4582-b4dc-52ee75a34c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:12.637907 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-82d54367-492b-4582-b4dc-52ee75a34c2e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:12.639079 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-82d54367-492b-4582-b4dc-52ee75a34c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:12.699134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1123/2238] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:12.709269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:12.711407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:12.775185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086088-c064-493d-9e11-1aaaa7abd26c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:12.779018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f56a02-2f42-4c41-a29a-76ba4e1fca47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:12.779667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f56a02-2f42-4c41-a29a-76ba4e1fca47 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:12.779953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f56a02-2f42-4c41-a29a-76ba4e1fca47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:12.780221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f56a02-2f42-4c41-a29a-76ba4e1fca47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:12.790348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f56a02-2f42-4c41-a29a-76ba4e1fca47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:12.791879 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f56a02-2f42-4c41-a29a-76ba4e1fca47 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:12.805241 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1116/2239] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:13.055655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d54367-492b-4582-b4dc-52ee75a34c2e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:13.057157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-82d54367-492b-4582-b4dc-52ee75a34c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:13.069757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d54367-492b-4582-b4dc-52ee75a34c2e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:13.074673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:13.075520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.075800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.076072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] PATH_INFO: `/v3/projects/3e1d85b509b147f3ac9266617fc9bbe1` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.077296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1d85b509b147f3ac9266617fc9bbe1)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:13.079204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:13.125470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1d85b509b147f3ac9266617fc9bbe1', 'request_id': 'req-16e89e88-ff97-4855-ba71-340dc9dd595a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:13.131393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1d85b509b147f3ac9266617fc9bbe1', 'request_id': 'req-16e89e88-ff97-4855-ba71-340dc9dd595a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:13.139406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1d85b509b147f3ac9266617fc9bbe1', 'request_id': 'req-16e89e88-ff97-4855-ba71-340dc9dd595a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:13.149997 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] The token cache is being invalidate because project 3e1d85b509b147f3ac9266617fc9bbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:42:13.150294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:13.152753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-16e89e88-ff97-4855-ba71-340dc9dd595a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:13.154700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1124/2240] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:42:13 2022] DELETE /identity/v3/projects/3e1d85b509b147f3ac9266617fc9bbe1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:13.160147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda558-56d4-4893-a8e5-bd903386b9a2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.160457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda558-56d4-4893-a8e5-bd903386b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.160733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afda558-56d4-4893-a8e5-bd903386b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.178667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1afda558-56d4-4893-a8e5-bd903386b9a2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:13.179864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1afda558-56d4-4893-a8e5-bd903386b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:13.236625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1117/2241] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:13.244581 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57292933-4297-4d09-87c0-560c4896cadc None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.244868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57292933-4297-4d09-87c0-560c4896cadc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.245236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57292933-4297-4d09-87c0-560c4896cadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.263535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-57292933-4297-4d09-87c0-560c4896cadc None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:13.264671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-57292933-4297-4d09-87c0-560c4896cadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:13.272932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1125/2242] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:13.277042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda558-56d4-4893-a8e5-bd903386b9a2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:13.286484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afda558-56d4-4893-a8e5-bd903386b9a2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:13.291038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a27a1b-774c-404b-9f58-28dc7ebecff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:13.291704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a27a1b-774c-404b-9f58-28dc7ebecff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.291982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a27a1b-774c-404b-9f58-28dc7ebecff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.292255 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a27a1b-774c-404b-9f58-28dc7ebecff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.293033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a27a1b-774c-404b-9f58-28dc7ebecff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:42:13.293320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a27a1b-774c-404b-9f58-28dc7ebecff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:13.294928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a27a1b-774c-404b-9f58-28dc7ebecff2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:13.305993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1118/2243] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:42:13.309998 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57292933-4297-4d09-87c0-560c4896cadc None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:13.318714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57292933-4297-4d09-87c0-560c4896cadc None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:13.324110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4490a-8515-456d-8d9b-20980ba34cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:13.324773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4490a-8515-456d-8d9b-20980ba34cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.325051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4490a-8515-456d-8d9b-20980ba34cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.325317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4490a-8515-456d-8d9b-20980ba34cf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.326002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4490a-8515-456d-8d9b-20980ba34cf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:13.327857 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4490a-8515-456d-8d9b-20980ba34cf6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:13.352519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1126/2244] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:42:13 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:13.356337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a27a1b-774c-404b-9f58-28dc7ebecff2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:13.366037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a27a1b-774c-404b-9f58-28dc7ebecff2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:13.419540 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff0e5b-3015-4d1a-8fd7-a918df0f30d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:13.420214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff0e5b-3015-4d1a-8fd7-a918df0f30d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.420510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff0e5b-3015-4d1a-8fd7-a918df0f30d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.420785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff0e5b-3015-4d1a-8fd7-a918df0f30d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.421482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff0e5b-3015-4d1a-8fd7-a918df0f30d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:13.423369 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff0e5b-3015-4d1a-8fd7-a918df0f30d7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:13.442527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1119/2245] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:42:13 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:13.447092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4490a-8515-456d-8d9b-20980ba34cf6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:13.457933 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4490a-8515-456d-8d9b-20980ba34cf6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:13.463989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ae57e-fb7b-4c1b-b919-1e84ec7cca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:13.464686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ae57e-fb7b-4c1b-b919-1e84ec7cca8b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.464963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ae57e-fb7b-4c1b-b919-1e84ec7cca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.465233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ae57e-fb7b-4c1b-b919-1e84ec7cca8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.465967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ae57e-fb7b-4c1b-b919-1e84ec7cca8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:13.468844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ae57e-fb7b-4c1b-b919-1e84ec7cca8b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:13.479295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1127/2246] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:42:13.483297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff0e5b-3015-4d1a-8fd7-a918df0f30d7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:13.493643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff0e5b-3015-4d1a-8fd7-a918df0f30d7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:13.498265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad146969-9fba-4552-8aee-1e80902ef9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:13.498907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad146969-9fba-4552-8aee-1e80902ef9cc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.499214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad146969-9fba-4552-8aee-1e80902ef9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.499495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad146969-9fba-4552-8aee-1e80902ef9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.500247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad146969-9fba-4552-8aee-1e80902ef9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:13.501874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad146969-9fba-4552-8aee-1e80902ef9cc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:13.512101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1120/2247] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:13.515957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ae57e-fb7b-4c1b-b919-1e84ec7cca8b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:13.525691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ae57e-fb7b-4c1b-b919-1e84ec7cca8b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:13.530282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac3ff-e6b9-4eaf-a1b8-25b42a357034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:13.531134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac3ff-e6b9-4eaf-a1b8-25b42a357034 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.531408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac3ff-e6b9-4eaf-a1b8-25b42a357034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.531675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ac3ff-e6b9-4eaf-a1b8-25b42a357034 admin admin] PATH_INFO: `/v3/projects/a90c5dfb972244c1aa625e07b1e3fe40/users/f182c5215d37423da1a00cbb98757957/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.545969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ac3ff-e6b9-4eaf-a1b8-25b42a357034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90c5dfb972244c1aa625e07b1e3fe40, user_id=f182c5215d37423da1a00cbb98757957, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:13.548615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ac3ff-e6b9-4eaf-a1b8-25b42a357034 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:13.562137 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1128/2248] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:13 2022] PUT /identity/v3/projects/a90c5dfb972244c1aa625e07b1e3fe40/users/f182c5215d37423da1a00cbb98757957/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:42:13.567052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40fe2f-ae82-4378-9f64-554beaf03461 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.567341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40fe2f-ae82-4378-9f64-554beaf03461 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.567620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40fe2f-ae82-4378-9f64-554beaf03461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.587416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ec40fe2f-ae82-4378-9f64-554beaf03461 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:13.588627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ec40fe2f-ae82-4378-9f64-554beaf03461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:13.654152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1121/2249] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:13.667559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac3ff-e6b9-4eaf-a1b8-25b42a357034 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:13.669354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c49ac3ff-e6b9-4eaf-a1b8-25b42a357034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:13.735618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ac3ff-e6b9-4eaf-a1b8-25b42a357034 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:13.739684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f992d-19b3-444e-9cc2-0a8d430c927c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:13.740331 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f992d-19b3-444e-9cc2-0a8d430c927c service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:13.740650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f992d-19b3-444e-9cc2-0a8d430c927c service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:13.741509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f992d-19b3-444e-9cc2-0a8d430c927c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:13.754722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f992d-19b3-444e-9cc2-0a8d430c927c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:13.756182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f992d-19b3-444e-9cc2-0a8d430c927c service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:13.768066 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1129/2250] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:42:17.361012 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40fe2f-ae82-4378-9f64-554beaf03461 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:17.366342 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ec40fe2f-ae82-4378-9f64-554beaf03461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:17.382477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40fe2f-ae82-4378-9f64-554beaf03461 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:17.387730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:17.389051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:17.389477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:17.389893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] PATH_INFO: `/v3/users/78baffba33c44ea792851dcb1ebf8209` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:17.391441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78baffba33c44ea792851dcb1ebf8209)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:17.394539 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:17.456990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78baffba33c44ea792851dcb1ebf8209'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:17.471877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78baffba33c44ea792851dcb1ebf8209'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:17.511026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78baffba33c44ea792851dcb1ebf8209'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:17.514483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78baffba33c44ea792851dcb1ebf8209'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:17.534747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78baffba33c44ea792851dcb1ebf8209'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:17.547172 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1122/2251] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:42:17 2022] DELETE /identity/v3/users/78baffba33c44ea792851dcb1ebf8209 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:17.549729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606f05e-c457-4a6f-afa6-13a69c85325f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:17.550586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606f05e-c457-4a6f-afa6-13a69c85325f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:17.551243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606f05e-c457-4a6f-afa6-13a69c85325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:17.615890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d606f05e-c457-4a6f-afa6-13a69c85325f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:17.620338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d606f05e-c457-4a6f-afa6-13a69c85325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:17.831801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1130/2252] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:17.836663 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:17.838084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:17.954520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42955f-1a8a-44aa-b936-142d1a3de4b3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:17.958664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09e17b-bdb7-4ee8-8ea1-72a205975e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:17.959531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e17b-bdb7-4ee8-8ea1-72a205975e21 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:17.959718 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e17b-bdb7-4ee8-8ea1-72a205975e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:17.960042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09e17b-bdb7-4ee8-8ea1-72a205975e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:17.973123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09e17b-bdb7-4ee8-8ea1-72a205975e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:17.974571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09e17b-bdb7-4ee8-8ea1-72a205975e21 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:17.992840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1123/2253] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:18.384049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606f05e-c457-4a6f-afa6-13a69c85325f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:18.385694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d606f05e-c457-4a6f-afa6-13a69c85325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:18.406609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606f05e-c457-4a6f-afa6-13a69c85325f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:18.421475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:18.422555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:18.423074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:18.423453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] PATH_INFO: `/v3/projects/46db12943b7e4c8cb32f490a9d91ea0c` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:18.426967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46db12943b7e4c8cb32f490a9d91ea0c)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:18.437401 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:18.552320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46db12943b7e4c8cb32f490a9d91ea0c', 'request_id': 'req-2bc3859b-34f6-4db1-b792-68bbc1b2d493'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:18.563948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46db12943b7e4c8cb32f490a9d91ea0c', 'request_id': 'req-2bc3859b-34f6-4db1-b792-68bbc1b2d493'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:18.590980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46db12943b7e4c8cb32f490a9d91ea0c', 'request_id': 'req-2bc3859b-34f6-4db1-b792-68bbc1b2d493'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:18.609953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] The token cache is being invalidate because project 46db12943b7e4c8cb32f490a9d91ea0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:42:18.610481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:18.612831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2bc3859b-34f6-4db1-b792-68bbc1b2d493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:18.615139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1131/2254] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:42:18 2022] DELETE /identity/v3/projects/46db12943b7e4c8cb32f490a9d91ea0c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:18.620969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c0a68-c56a-4c8d-9fc5-5fe675e1bfd2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:18.621684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c0a68-c56a-4c8d-9fc5-5fe675e1bfd2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:18.621684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c0a68-c56a-4c8d-9fc5-5fe675e1bfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:18.659787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-677c0a68-c56a-4c8d-9fc5-5fe675e1bfd2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:18.662156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-677c0a68-c56a-4c8d-9fc5-5fe675e1bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:18.712657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dae1ba-5da3-4033-a0e2-088893156391 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:18.712943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dae1ba-5da3-4033-a0e2-088893156391 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:18.713214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dae1ba-5da3-4033-a0e2-088893156391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:18.766425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1124/2255] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:18.773628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-79dae1ba-5da3-4033-a0e2-088893156391 None None] MFA Rules not processed for user `f182c5215d37423da1a00cbb98757957`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:18.775129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-79dae1ba-5da3-4033-a0e2-088893156391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:18.779793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ba73-69a6-4908-a15b-f0f79984f950 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:18.779793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ba73-69a6-4908-a15b-f0f79984f950 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:18.779793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ba73-69a6-4908-a15b-f0f79984f950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:18.816312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3082ba73-69a6-4908-a15b-f0f79984f950 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:18.817599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3082ba73-69a6-4908-a15b-f0f79984f950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:18.840969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1125/2256] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:18.845458 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ba73-69a6-4908-a15b-f0f79984f950 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:18.867032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ba73-69a6-4908-a15b-f0f79984f950 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:18.877156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346586b-9d46-454f-b7d2-a50a053eefdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:18.877829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346586b-9d46-454f-b7d2-a50a053eefdd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:18.878107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346586b-9d46-454f-b7d2-a50a053eefdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:18.878379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346586b-9d46-454f-b7d2-a50a053eefdd admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:18.879121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346586b-9d46-454f-b7d2-a50a053eefdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:42:18.879422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346586b-9d46-454f-b7d2-a50a053eefdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:18.881069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346586b-9d46-454f-b7d2-a50a053eefdd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:18.894470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1126/2257] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:42:18.903905 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346586b-9d46-454f-b7d2-a50a053eefdd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:18.913839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1132/2258] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:18.919413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dae1ba-5da3-4033-a0e2-088893156391 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:18.921537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-79dae1ba-5da3-4033-a0e2-088893156391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:18.922207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346586b-9d46-454f-b7d2-a50a053eefdd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:18.928225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d829b7-fdca-4717-9cfa-3f90ccad175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:18.929440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d829b7-fdca-4717-9cfa-3f90ccad175e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:18.930498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d829b7-fdca-4717-9cfa-3f90ccad175e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:18.931004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d829b7-fdca-4717-9cfa-3f90ccad175e admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:18.932232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d829b7-fdca-4717-9cfa-3f90ccad175e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:18.934399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d829b7-fdca-4717-9cfa-3f90ccad175e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:18.945961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dae1ba-5da3-4033-a0e2-088893156391 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:18.957161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab273a3-01a1-49cf-b03c-716198e69b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:18.958111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab273a3-01a1-49cf-b03c-716198e69b9d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:18.958499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab273a3-01a1-49cf-b03c-716198e69b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:18.958879 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab273a3-01a1-49cf-b03c-716198e69b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:18.960909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab273a3-01a1-49cf-b03c-716198e69b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:18.968830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab273a3-01a1-49cf-b03c-716198e69b9d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:18.974783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1127/2259] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:42:18 2022] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:18.979783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d829b7-fdca-4717-9cfa-3f90ccad175e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.032720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1133/2260] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:42:18 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:19.033839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab273a3-01a1-49cf-b03c-716198e69b9d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.040477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9ab273a3-01a1-49cf-b03c-716198e69b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:19.096131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d829b7-fdca-4717-9cfa-3f90ccad175e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.138272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab273a3-01a1-49cf-b03c-716198e69b9d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.143424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.144457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.144736 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.145009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] PATH_INFO: `/v3/users/0e8efc8157234567bcc9487e175cabb7` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.146264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8efc8157234567bcc9487e175cabb7)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.148814 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.185949 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3be0d7-0ee9-4ffc-88f1-7c23488fc481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.186627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3be0d7-0ee9-4ffc-88f1-7c23488fc481 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.186911 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3be0d7-0ee9-4ffc-88f1-7c23488fc481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.187187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3be0d7-0ee9-4ffc-88f1-7c23488fc481 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.187887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3be0d7-0ee9-4ffc-88f1-7c23488fc481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.189837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3be0d7-0ee9-4ffc-88f1-7c23488fc481 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.211323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8efc8157234567bcc9487e175cabb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:19.218914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1128/2261] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:42:18 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:19.218914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3be0d7-0ee9-4ffc-88f1-7c23488fc481 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.224834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8efc8157234567bcc9487e175cabb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:19.227850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3be0d7-0ee9-4ffc-88f1-7c23488fc481 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.234202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8efc8157234567bcc9487e175cabb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:19.237958 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e74e1-0a5a-43f2-8bf2-282b31a84309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.238641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e74e1-0a5a-43f2-8bf2-282b31a84309 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.238922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e74e1-0a5a-43f2-8bf2-282b31a84309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.239194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e74e1-0a5a-43f2-8bf2-282b31a84309 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.239910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e74e1-0a5a-43f2-8bf2-282b31a84309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.242573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e74e1-0a5a-43f2-8bf2-282b31a84309 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.251339 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8efc8157234567bcc9487e175cabb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:19.252925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8efc8157234567bcc9487e175cabb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:19.264475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1134/2262] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:42:19 2022] DELETE /identity/v3/users/0e8efc8157234567bcc9487e175cabb7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:19.264475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.264758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:19.268987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1129/2263] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:42:19 2022] POST /identity/v3/users => generated 296 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:19.270402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d7360-c0b7-43a8-afcd-6310728f9f36 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.270996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d7360-c0b7-43a8-afcd-6310728f9f36 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.271379 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d7360-c0b7-43a8-afcd-6310728f9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.290557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b72d7360-c0b7-43a8-afcd-6310728f9f36 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:19.291597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b72d7360-c0b7-43a8-afcd-6310728f9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:19.336914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cccda1-ada5-435d-a10b-66e83574424b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.341590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89efba-9d0c-4243-9435-6f5e1723971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.342256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89efba-9d0c-4243-9435-6f5e1723971e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.342533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89efba-9d0c-4243-9435-6f5e1723971e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.342808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89efba-9d0c-4243-9435-6f5e1723971e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.343533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89efba-9d0c-4243-9435-6f5e1723971e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.345157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89efba-9d0c-4243-9435-6f5e1723971e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.351167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1130/2264] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:19.352266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d7360-c0b7-43a8-afcd-6310728f9f36 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.353693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b72d7360-c0b7-43a8-afcd-6310728f9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:19.355769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1135/2265] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:19.361236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89efba-9d0c-4243-9435-6f5e1723971e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.366833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d7360-c0b7-43a8-afcd-6310728f9f36 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.371634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc314698-87ed-4216-968f-fc135cb9884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.371767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89efba-9d0c-4243-9435-6f5e1723971e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.372229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc314698-87ed-4216-968f-fc135cb9884a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.372542 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc314698-87ed-4216-968f-fc135cb9884a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.372841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc314698-87ed-4216-968f-fc135cb9884a admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.373567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc314698-87ed-4216-968f-fc135cb9884a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.375136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc314698-87ed-4216-968f-fc135cb9884a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.376548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252a830-edd0-45b0-afa7-237669441873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.377300 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252a830-edd0-45b0-afa7-237669441873 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.377582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252a830-edd0-45b0-afa7-237669441873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.377862 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252a830-edd0-45b0-afa7-237669441873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.378620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252a830-edd0-45b0-afa7-237669441873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.380185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252a830-edd0-45b0-afa7-237669441873 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.385002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1131/2266] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:19.385883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc314698-87ed-4216-968f-fc135cb9884a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.387570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fc314698-87ed-4216-968f-fc135cb9884a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:19.390733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1136/2267] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:19.391595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252a830-edd0-45b0-afa7-237669441873 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.402911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252a830-edd0-45b0-afa7-237669441873 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.407744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4af192-ca1c-41a6-9d15-d1ebdd54899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.408645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af192-ca1c-41a6-9d15-d1ebdd54899a admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.408923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af192-ca1c-41a6-9d15-d1ebdd54899a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.409196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4af192-ca1c-41a6-9d15-d1ebdd54899a admin admin] PATH_INFO: `/v3/projects/50366d8339e8453d810e04b48706f155/users/887c4d1919544712a623981a7e6b7604/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.424235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4af192-ca1c-41a6-9d15-d1ebdd54899a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50366d8339e8453d810e04b48706f155, user_id=887c4d1919544712a623981a7e6b7604, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.426899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4af192-ca1c-41a6-9d15-d1ebdd54899a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.440490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1137/2268] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:19 2022] PUT /identity/v3/projects/50366d8339e8453d810e04b48706f155/users/887c4d1919544712a623981a7e6b7604/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:19.441361 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4af192-ca1c-41a6-9d15-d1ebdd54899a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.447325 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc314698-87ed-4216-968f-fc135cb9884a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.498623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807e74b-af13-41e4-b78a-969a25ee10e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.499273 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807e74b-af13-41e4-b78a-969a25ee10e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.499556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807e74b-af13-41e4-b78a-969a25ee10e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.499834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807e74b-af13-41e4-b78a-969a25ee10e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.502109 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4af192-ca1c-41a6-9d15-d1ebdd54899a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.506778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5223a1-9362-4f60-b448-11a8da257bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.507649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5223a1-9362-4f60-b448-11a8da257bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.507922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5223a1-9362-4f60-b448-11a8da257bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.508199 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5223a1-9362-4f60-b448-11a8da257bf7 admin admin] PATH_INFO: `/v3/projects/04a8e9f1e7c849b4b21ea1259dce85ae/users/f6737ecc301648f9afd1c597d8b6a7c5/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.509284 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807e74b-af13-41e4-b78a-969a25ee10e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.510781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807e74b-af13-41e4-b78a-969a25ee10e9 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.520318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1132/2269] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:19.522907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807e74b-af13-41e4-b78a-969a25ee10e9 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.524163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5223a1-9362-4f60-b448-11a8da257bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a8e9f1e7c849b4b21ea1259dce85ae, user_id=f6737ecc301648f9afd1c597d8b6a7c5, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.526953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5223a1-9362-4f60-b448-11a8da257bf7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.533708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807e74b-af13-41e4-b78a-969a25ee10e9 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.539611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc5b7c-53d7-4f45-8eeb-32bf925806fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.540334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc5b7c-53d7-4f45-8eeb-32bf925806fb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.540647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc5b7c-53d7-4f45-8eeb-32bf925806fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.540953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc5b7c-53d7-4f45-8eeb-32bf925806fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.541684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc5b7c-53d7-4f45-8eeb-32bf925806fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.542690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1138/2270] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:19 2022] PUT /identity/v3/projects/04a8e9f1e7c849b4b21ea1259dce85ae/users/f6737ecc301648f9afd1c597d8b6a7c5/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:19.543436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc5b7c-53d7-4f45-8eeb-32bf925806fb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.552652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b79e-a16f-4de9-91c2-9dd1e506221a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.553207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b79e-a16f-4de9-91c2-9dd1e506221a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.553383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586b79e-a16f-4de9-91c2-9dd1e506221a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.557529 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1133/2271] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:19.558610 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc5b7c-53d7-4f45-8eeb-32bf925806fb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.569715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc5b7c-53d7-4f45-8eeb-32bf925806fb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.587823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c586b79e-a16f-4de9-91c2-9dd1e506221a None None] MFA Rules not processed for user `f6737ecc301648f9afd1c597d8b6a7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:19.589392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c586b79e-a16f-4de9-91c2-9dd1e506221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:19.632502 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8d77f-6b33-446f-b4c6-dcbfdf31f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.633497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8d77f-6b33-446f-b4c6-dcbfdf31f460 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.633844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8d77f-6b33-446f-b4c6-dcbfdf31f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.634184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8d77f-6b33-446f-b4c6-dcbfdf31f460 admin admin] PATH_INFO: `/v3/projects/50366d8339e8453d810e04b48706f155/users/887c4d1919544712a623981a7e6b7604/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.636377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8d77f-6b33-446f-b4c6-dcbfdf31f460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50366d8339e8453d810e04b48706f155, user_id=887c4d1919544712a623981a7e6b7604, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.639326 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8d77f-6b33-446f-b4c6-dcbfdf31f460 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.651427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1134/2272] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:19 2022] PUT /identity/v3/projects/50366d8339e8453d810e04b48706f155/users/887c4d1919544712a623981a7e6b7604/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:42:19.660880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1139/2273] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:19.671601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8d77f-6b33-446f-b4c6-dcbfdf31f460 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.674111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8be8d77f-6b33-446f-b4c6-dcbfdf31f460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:19.759605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8d77f-6b33-446f-b4c6-dcbfdf31f460 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.765570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18af932-5ee1-4774-b48c-214328776db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.766828 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18af932-5ee1-4774-b48c-214328776db7 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.767126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18af932-5ee1-4774-b48c-214328776db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.767545 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18af932-5ee1-4774-b48c-214328776db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.814876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586b79e-a16f-4de9-91c2-9dd1e506221a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:19.816413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c586b79e-a16f-4de9-91c2-9dd1e506221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:19.835443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586b79e-a16f-4de9-91c2-9dd1e506221a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:19.847684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18af932-5ee1-4774-b48c-214328776db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.850825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18af932-5ee1-4774-b48c-214328776db7 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:19.870258 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1135/2274] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:19.919660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:19.920576 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:19.921157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:19.921447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] PATH_INFO: `/v3/projects/86d2e59c240e4978811056c1b77c5980` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:19.922976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d2e59c240e4978811056c1b77c5980)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:19.924919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:20.010969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d2e59c240e4978811056c1b77c5980', 'request_id': 'req-d21df041-a25f-4e75-9a26-66cecd0c9196'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:20.041515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d2e59c240e4978811056c1b77c5980', 'request_id': 'req-d21df041-a25f-4e75-9a26-66cecd0c9196'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:20.058133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d2e59c240e4978811056c1b77c5980', 'request_id': 'req-d21df041-a25f-4e75-9a26-66cecd0c9196'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:20.074587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] The token cache is being invalidate because project 86d2e59c240e4978811056c1b77c5980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:42:20.075100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:20.076112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-d21df041-a25f-4e75-9a26-66cecd0c9196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:20.082889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1140/2275] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:42:19 2022] DELETE /identity/v3/projects/86d2e59c240e4978811056c1b77c5980 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:42:20.088393 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5a757-611a-460e-8f15-eaf6d863c6b6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:20.088690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5a757-611a-460e-8f15-eaf6d863c6b6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:20.088963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5a757-611a-460e-8f15-eaf6d863c6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:20.113703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-44c5a757-611a-460e-8f15-eaf6d863c6b6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:20.114966 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-44c5a757-611a-460e-8f15-eaf6d863c6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:20.198693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1136/2276] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:20.207523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc959-d76e-47c4-b510-a2748162f9b5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:20.207942 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc959-d76e-47c4-b510-a2748162f9b5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:20.208457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc959-d76e-47c4-b510-a2748162f9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:20.248880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-376bc959-d76e-47c4-b510-a2748162f9b5 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:20.250429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-376bc959-d76e-47c4-b510-a2748162f9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:20.264392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1141/2277] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:20.267100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5a757-611a-460e-8f15-eaf6d863c6b6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:20.285556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5a757-611a-460e-8f15-eaf6d863c6b6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:20.305095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b9a5-8a6b-4ff3-acff-a061063a3400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:20.305784 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b9a5-8a6b-4ff3-acff-a061063a3400 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:20.306071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b9a5-8a6b-4ff3-acff-a061063a3400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:20.306346 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358b9a5-8a6b-4ff3-acff-a061063a3400 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:20.307098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358b9a5-8a6b-4ff3-acff-a061063a3400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:42:20.307430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358b9a5-8a6b-4ff3-acff-a061063a3400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:20.309471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358b9a5-8a6b-4ff3-acff-a061063a3400 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:20.345581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1137/2278] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:42:20.349558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bc959-d76e-47c4-b510-a2748162f9b5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:20.372829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bc959-d76e-47c4-b510-a2748162f9b5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:20.387579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641559d-afa0-4b25-a012-478114941a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:20.388305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641559d-afa0-4b25-a012-478114941a95 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:20.390446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641559d-afa0-4b25-a012-478114941a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:20.391406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641559d-afa0-4b25-a012-478114941a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:20.392187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641559d-afa0-4b25-a012-478114941a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:20.396738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641559d-afa0-4b25-a012-478114941a95 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:20.461303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1142/2279] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:42:20 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:20.465647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b9a5-8a6b-4ff3-acff-a061063a3400 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:20.484617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358b9a5-8a6b-4ff3-acff-a061063a3400 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:20.586080 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c5521-05ca-480d-865c-cfee0cea7cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:20.586966 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c5521-05ca-480d-865c-cfee0cea7cfb admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:20.587393 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c5521-05ca-480d-865c-cfee0cea7cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:20.587937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c5521-05ca-480d-865c-cfee0cea7cfb admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:20.588906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c5521-05ca-480d-865c-cfee0cea7cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:20.593196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c5521-05ca-480d-865c-cfee0cea7cfb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:20.627140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641559d-afa0-4b25-a012-478114941a95 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:20.632755 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1138/2280] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:42:20 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:20.646617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641559d-afa0-4b25-a012-478114941a95 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:20.655645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f48f25-132d-4162-8c1b-8172eb11c265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:20.657294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f48f25-132d-4162-8c1b-8172eb11c265 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:20.657966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f48f25-132d-4162-8c1b-8172eb11c265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:20.658476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f48f25-132d-4162-8c1b-8172eb11c265 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:20.659405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f48f25-132d-4162-8c1b-8172eb11c265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:20.661846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f48f25-132d-4162-8c1b-8172eb11c265 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:20.684092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1143/2281] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:20.689081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c5521-05ca-480d-865c-cfee0cea7cfb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:20.700870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c5521-05ca-480d-865c-cfee0cea7cfb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:20.706553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79005c4e-b53e-47ba-b45a-d43b6d7ec105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:20.707308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005c4e-b53e-47ba-b45a-d43b6d7ec105 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:20.709191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005c4e-b53e-47ba-b45a-d43b6d7ec105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:20.710672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005c4e-b53e-47ba-b45a-d43b6d7ec105 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:20.711673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79005c4e-b53e-47ba-b45a-d43b6d7ec105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:20.714132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79005c4e-b53e-47ba-b45a-d43b6d7ec105 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:20.728859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1139/2282] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:42:20.733635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f48f25-132d-4162-8c1b-8172eb11c265 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:20.749315 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f48f25-132d-4162-8c1b-8172eb11c265 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:20.765944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdff55f-eb71-47c3-be8e-d73191f52ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:20.767191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdff55f-eb71-47c3-be8e-d73191f52ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:20.767476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdff55f-eb71-47c3-be8e-d73191f52ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:20.768447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdff55f-eb71-47c3-be8e-d73191f52ef4 admin admin] PATH_INFO: `/v3/projects/2522ca4f15014980bf5f860bd0e04d97/users/ce80c3b3df914915a565135e026349ba/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:20.787729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdff55f-eb71-47c3-be8e-d73191f52ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2522ca4f15014980bf5f860bd0e04d97, user_id=ce80c3b3df914915a565135e026349ba, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:20.791678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdff55f-eb71-47c3-be8e-d73191f52ef4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:20.817416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1144/2283] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:20 2022] PUT /identity/v3/projects/2522ca4f15014980bf5f860bd0e04d97/users/ce80c3b3df914915a565135e026349ba/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:42:20.820086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c42cf-fff0-4c2a-995d-e45f55b96a58 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:20.820811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c42cf-fff0-4c2a-995d-e45f55b96a58 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:20.821567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c42cf-fff0-4c2a-995d-e45f55b96a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:20.859623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-797c42cf-fff0-4c2a-995d-e45f55b96a58 None None] MFA Rules not processed for user `ce80c3b3df914915a565135e026349ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:20.861526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-797c42cf-fff0-4c2a-995d-e45f55b96a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:20.961301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1140/2284] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:20.962795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdff55f-eb71-47c3-be8e-d73191f52ef4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:21.064479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdff55f-eb71-47c3-be8e-d73191f52ef4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:21.076747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c166f53-1f3d-42b5-bf5d-cd77ed6744cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:21.078419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c166f53-1f3d-42b5-bf5d-cd77ed6744cb admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:21.079016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c166f53-1f3d-42b5-bf5d-cd77ed6744cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:21.079721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c166f53-1f3d-42b5-bf5d-cd77ed6744cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:21.080795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c166f53-1f3d-42b5-bf5d-cd77ed6744cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:21.086067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c166f53-1f3d-42b5-bf5d-cd77ed6744cb admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:21.133431 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1145/2285] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:42:20 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:21.134460 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c42cf-fff0-4c2a-995d-e45f55b96a58 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:21.153059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c42cf-fff0-4c2a-995d-e45f55b96a58 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:21.234163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdf8c0-ee05-468f-951c-134a0be447a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:21.236166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdf8c0-ee05-468f-951c-134a0be447a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:21.237209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdf8c0-ee05-468f-951c-134a0be447a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:21.237636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdf8c0-ee05-468f-951c-134a0be447a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:21.238560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdf8c0-ee05-468f-951c-134a0be447a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:21.241929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdf8c0-ee05-468f-951c-134a0be447a7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:21.267473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1141/2286] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:42:21 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:42:21.268725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c166f53-1f3d-42b5-bf5d-cd77ed6744cb admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:21.279518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c166f53-1f3d-42b5-bf5d-cd77ed6744cb admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:21.286809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0af649-d8d5-4d89-83b5-37662a1e0d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:21.287734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0af649-d8d5-4d89-83b5-37662a1e0d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:21.287880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0af649-d8d5-4d89-83b5-37662a1e0d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:21.288124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0af649-d8d5-4d89-83b5-37662a1e0d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:21.289275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0af649-d8d5-4d89-83b5-37662a1e0d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:21.290520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0af649-d8d5-4d89-83b5-37662a1e0d8c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:21.304330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1146/2287] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:21.305597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdf8c0-ee05-468f-951c-134a0be447a7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:21.316374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdf8c0-ee05-468f-951c-134a0be447a7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:21.323959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882a422-b42d-4d97-ad24-67fa2250d5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:21.324670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882a422-b42d-4d97-ad24-67fa2250d5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:21.324953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882a422-b42d-4d97-ad24-67fa2250d5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:21.325585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882a422-b42d-4d97-ad24-67fa2250d5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:21.326476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882a422-b42d-4d97-ad24-67fa2250d5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:21.328457 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882a422-b42d-4d97-ad24-67fa2250d5b8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:21.350101 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0af649-d8d5-4d89-83b5-37662a1e0d8c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:21.356395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1142/2288] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:21.362229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0af649-d8d5-4d89-83b5-37662a1e0d8c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:21.367932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27174036-a110-40bf-a214-6cc215e99c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:21.368866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27174036-a110-40bf-a214-6cc215e99c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:21.369140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27174036-a110-40bf-a214-6cc215e99c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:21.369419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27174036-a110-40bf-a214-6cc215e99c24 admin admin] PATH_INFO: `/v3/projects/39d1f073d5e84db2980930051ac81e4f/users/3615eab075e441daae45707f59c3828b/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:21.386173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27174036-a110-40bf-a214-6cc215e99c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d1f073d5e84db2980930051ac81e4f, user_id=3615eab075e441daae45707f59c3828b, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:21.388873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27174036-a110-40bf-a214-6cc215e99c24 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:21.405195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1147/2289] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:21 2022] PUT /identity/v3/projects/39d1f073d5e84db2980930051ac81e4f/users/3615eab075e441daae45707f59c3828b/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:21.416639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62b3b-8882-4382-a7f7-cf2a5a7a1f2f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:21.416639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62b3b-8882-4382-a7f7-cf2a5a7a1f2f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:21.416903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62b3b-8882-4382-a7f7-cf2a5a7a1f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:21.454642 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-34b62b3b-8882-4382-a7f7-cf2a5a7a1f2f None None] MFA Rules not processed for user `3615eab075e441daae45707f59c3828b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:21.456644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-34b62b3b-8882-4382-a7f7-cf2a5a7a1f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:21.558783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1143/2290] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:21.562957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27174036-a110-40bf-a214-6cc215e99c24 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:21.671892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27174036-a110-40bf-a214-6cc215e99c24 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:21.686031 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb028a2-a422-46c6-a4e5-d22a36ed4965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:21.689568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb028a2-a422-46c6-a4e5-d22a36ed4965 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:21.689966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb028a2-a422-46c6-a4e5-d22a36ed4965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:21.692143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb028a2-a422-46c6-a4e5-d22a36ed4965 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:21.696371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb028a2-a422-46c6-a4e5-d22a36ed4965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:21.698683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb028a2-a422-46c6-a4e5-d22a36ed4965 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:21.755307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1148/2291] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:42:21 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:21.759538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b62b3b-8882-4382-a7f7-cf2a5a7a1f2f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:21.777807 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b62b3b-8882-4382-a7f7-cf2a5a7a1f2f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:21.902946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cfb73-077a-4c62-86bb-1f1434f48657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:21.905032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cfb73-077a-4c62-86bb-1f1434f48657 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:21.905445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cfb73-077a-4c62-86bb-1f1434f48657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:21.911635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cfb73-077a-4c62-86bb-1f1434f48657 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:21.912560 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cfb73-077a-4c62-86bb-1f1434f48657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:21.914595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cfb73-077a-4c62-86bb-1f1434f48657 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:21.943723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1144/2292] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:42:21 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:21.946987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb028a2-a422-46c6-a4e5-d22a36ed4965 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:21.960057 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb028a2-a422-46c6-a4e5-d22a36ed4965 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:21.967315 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60372884-dd48-4985-943e-f1dcf308ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:21.968227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60372884-dd48-4985-943e-f1dcf308ac8d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:21.968608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60372884-dd48-4985-943e-f1dcf308ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:21.968948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60372884-dd48-4985-943e-f1dcf308ac8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:21.969801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60372884-dd48-4985-943e-f1dcf308ac8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:21.972082 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60372884-dd48-4985-943e-f1dcf308ac8d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:21.994571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1149/2293] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:42:21.995745 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cfb73-077a-4c62-86bb-1f1434f48657 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:22.011405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cfb73-077a-4c62-86bb-1f1434f48657 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:22.017567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff9b00-8583-43b2-ac24-e9223f4ea227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:22.018832 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff9b00-8583-43b2-ac24-e9223f4ea227 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:22.019276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff9b00-8583-43b2-ac24-e9223f4ea227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:22.019793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff9b00-8583-43b2-ac24-e9223f4ea227 admin admin] PATH_INFO: `/v3/projects/d332ae79487846ee9ce2b560e1a3c686/users/d4a24cd59aa44fde9a476f12598e3cb5/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:22.045559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff9b00-8583-43b2-ac24-e9223f4ea227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d332ae79487846ee9ce2b560e1a3c686, user_id=d4a24cd59aa44fde9a476f12598e3cb5, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:22.049373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff9b00-8583-43b2-ac24-e9223f4ea227 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:22.078122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1145/2294] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:21 2022] PUT /identity/v3/projects/d332ae79487846ee9ce2b560e1a3c686/users/d4a24cd59aa44fde9a476f12598e3cb5/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:22.086815 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60372884-dd48-4985-943e-f1dcf308ac8d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:22.111572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60372884-dd48-4985-943e-f1dcf308ac8d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:22.176322 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81224c-d111-43bd-b5b9-5eb39151591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:22.177363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81224c-d111-43bd-b5b9-5eb39151591b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:22.177363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81224c-d111-43bd-b5b9-5eb39151591b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:22.177634 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81224c-d111-43bd-b5b9-5eb39151591b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:22.178407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81224c-d111-43bd-b5b9-5eb39151591b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:22.180126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81224c-d111-43bd-b5b9-5eb39151591b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:22.196689 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1150/2295] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:22.198661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff9b00-8583-43b2-ac24-e9223f4ea227 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:22.213023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff9b00-8583-43b2-ac24-e9223f4ea227 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:22.219437 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374dd7-13c4-4be1-8bf1-d4b6b1cdc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:22.223382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374dd7-13c4-4be1-8bf1-d4b6b1cdc6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:22.224066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374dd7-13c4-4be1-8bf1-d4b6b1cdc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:22.224487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374dd7-13c4-4be1-8bf1-d4b6b1cdc6dc admin admin] PATH_INFO: `/v3/projects/d332ae79487846ee9ce2b560e1a3c686/users/d4a24cd59aa44fde9a476f12598e3cb5/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:22.228290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374dd7-13c4-4be1-8bf1-d4b6b1cdc6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d332ae79487846ee9ce2b560e1a3c686, user_id=d4a24cd59aa44fde9a476f12598e3cb5, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:22.231954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374dd7-13c4-4be1-8bf1-d4b6b1cdc6dc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:22.252461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1146/2296] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:22 2022] PUT /identity/v3/projects/d332ae79487846ee9ce2b560e1a3c686/users/d4a24cd59aa44fde9a476f12598e3cb5/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:22.259398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7d1f4-d6a5-4dd0-a69f-48b927fa4b13 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:22.259681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7d1f4-d6a5-4dd0-a69f-48b927fa4b13 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:22.259950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7d1f4-d6a5-4dd0-a69f-48b927fa4b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:22.298139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a5c7d1f4-d6a5-4dd0-a69f-48b927fa4b13 None None] MFA Rules not processed for user `d4a24cd59aa44fde9a476f12598e3cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:22.299417 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a5c7d1f4-d6a5-4dd0-a69f-48b927fa4b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:22.442609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1151/2297] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:42:22.461220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374dd7-13c4-4be1-8bf1-d4b6b1cdc6dc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:22.463301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-03374dd7-13c4-4be1-8bf1-d4b6b1cdc6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:22.588085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374dd7-13c4-4be1-8bf1-d4b6b1cdc6dc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:22.592511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc78b0-de60-4ae1-9053-8bb97c1bf440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:22.593481 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc78b0-de60-4ae1-9053-8bb97c1bf440 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:22.593922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc78b0-de60-4ae1-9053-8bb97c1bf440 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:22.594534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc78b0-de60-4ae1-9053-8bb97c1bf440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:22.711057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc78b0-de60-4ae1-9053-8bb97c1bf440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:22.712606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc78b0-de60-4ae1-9053-8bb97c1bf440 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:22.752066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1147/2298] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:22.786142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabdd98-24df-418f-9496-9a0542c3ec58 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:22.786602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabdd98-24df-418f-9496-9a0542c3ec58 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:22.786680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabdd98-24df-418f-9496-9a0542c3ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:22.826646 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6aabdd98-24df-418f-9496-9a0542c3ec58 None None] MFA Rules not processed for user `9ba5c9aad52e4bfebae6958009e2f32f`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:22.828041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6aabdd98-24df-418f-9496-9a0542c3ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:22.922435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1152/2299] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:25.709623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc78b0-de60-4ae1-9053-8bb97c1bf440 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:25.727035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc78b0-de60-4ae1-9053-8bb97c1bf440 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:25.734472 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f42fd-df85-4085-a4bc-56fffc8af669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:25.735342 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f42fd-df85-4085-a4bc-56fffc8af669 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:25.735651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f42fd-df85-4085-a4bc-56fffc8af669 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:25.735928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f42fd-df85-4085-a4bc-56fffc8af669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:25.856976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f42fd-df85-4085-a4bc-56fffc8af669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:25.860373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f42fd-df85-4085-a4bc-56fffc8af669 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:25.894158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1148/2300] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:26.869106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653c283-532c-449c-b046-916a0b6b8a28 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:26.869590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653c283-532c-449c-b046-916a0b6b8a28 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:26.869699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653c283-532c-449c-b046-916a0b6b8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:26.947930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6653c283-532c-449c-b046-916a0b6b8a28 None None] MFA Rules not processed for user `887c4d1919544712a623981a7e6b7604`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:26.949229 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6653c283-532c-449c-b046-916a0b6b8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:27.061631 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f42fd-df85-4085-a4bc-56fffc8af669 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:27.082025 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f42fd-df85-4085-a4bc-56fffc8af669 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:27.087447 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cf324-1a45-4990-bfdf-3b8f88e12eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:27.088301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cf324-1a45-4990-bfdf-3b8f88e12eee service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:27.088748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cf324-1a45-4990-bfdf-3b8f88e12eee service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:27.089796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cf324-1a45-4990-bfdf-3b8f88e12eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:27.102158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1153/2301] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:27.116804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cf324-1a45-4990-bfdf-3b8f88e12eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:27.118916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cf324-1a45-4990-bfdf-3b8f88e12eee service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:27.121421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653c283-532c-449c-b046-916a0b6b8a28 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:27.122888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6653c283-532c-449c-b046-916a0b6b8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:27.135600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1149/2302] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:42:27.263721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653c283-532c-449c-b046-916a0b6b8a28 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:27.279395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d951320-3c16-4b57-a9f4-a9b9a986b48b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:27.281764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951320-3c16-4b57-a9f4-a9b9a986b48b service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:27.282068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951320-3c16-4b57-a9f4-a9b9a986b48b service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:27.282346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951320-3c16-4b57-a9f4-a9b9a986b48b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:27.286724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3d951320-3c16-4b57-a9f4-a9b9a986b48b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:27.421856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d951320-3c16-4b57-a9f4-a9b9a986b48b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:27.423882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d951320-3c16-4b57-a9f4-a9b9a986b48b service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:27.436071 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1154/2303] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:42:27.874020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cf324-1a45-4990-bfdf-3b8f88e12eee service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:27.875657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4e4cf324-1a45-4990-bfdf-3b8f88e12eee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:28.021435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cf324-1a45-4990-bfdf-3b8f88e12eee service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:28.026834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:28.027770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:28.028115 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:28.028620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] PATH_INFO: `/v3/users/f6737ecc301648f9afd1c597d8b6a7c5` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:28.029839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6737ecc301648f9afd1c597d8b6a7c5)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:28.031802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:28.085739 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6737ecc301648f9afd1c597d8b6a7c5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:28.093220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6737ecc301648f9afd1c597d8b6a7c5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:28.105772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6737ecc301648f9afd1c597d8b6a7c5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:28.106506 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6737ecc301648f9afd1c597d8b6a7c5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:28.114344 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6737ecc301648f9afd1c597d8b6a7c5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:28.120637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1150/2304] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:42:27 2022] DELETE /identity/v3/users/f6737ecc301648f9afd1c597d8b6a7c5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:42:28.125696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0390f-8652-4c63-b76f-50ff11ac50c6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:28.126193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0390f-8652-4c63-b76f-50ff11ac50c6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:28.126279 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0390f-8652-4c63-b76f-50ff11ac50c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:28.145923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-64d0390f-8652-4c63-b76f-50ff11ac50c6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:28.147744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-64d0390f-8652-4c63-b76f-50ff11ac50c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:28.219495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1155/2305] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:42:28.246697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:28.248604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:28.327048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0089d8e-9854-448c-b8cc-6d135ae9aeeb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:28.331756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8947252-c42e-4ce1-b0bb-639d1d58529c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:28.332586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8947252-c42e-4ce1-b0bb-639d1d58529c service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:28.333724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8947252-c42e-4ce1-b0bb-639d1d58529c service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:28.334162 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8947252-c42e-4ce1-b0bb-639d1d58529c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:28.347528 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8947252-c42e-4ce1-b0bb-639d1d58529c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:28.349670 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8947252-c42e-4ce1-b0bb-639d1d58529c service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:28.367055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1151/2306] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:42:29.317659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0390f-8652-4c63-b76f-50ff11ac50c6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:29.319831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-64d0390f-8652-4c63-b76f-50ff11ac50c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:29.339275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0390f-8652-4c63-b76f-50ff11ac50c6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:29.354898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:29.355873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:29.356153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:29.357391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] PATH_INFO: `/v3/projects/04a8e9f1e7c849b4b21ea1259dce85ae` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:29.361858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a8e9f1e7c849b4b21ea1259dce85ae)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:29.372703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:29.481754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a8e9f1e7c849b4b21ea1259dce85ae', 'request_id': 'req-5b1269f8-2548-49ad-8043-fdaedf631fb1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:29.489836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a8e9f1e7c849b4b21ea1259dce85ae', 'request_id': 'req-5b1269f8-2548-49ad-8043-fdaedf631fb1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:29.509478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a8e9f1e7c849b4b21ea1259dce85ae', 'request_id': 'req-5b1269f8-2548-49ad-8043-fdaedf631fb1'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:29.533817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] The token cache is being invalidate because project 04a8e9f1e7c849b4b21ea1259dce85ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:42:29.534325 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:29.535144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5b1269f8-2548-49ad-8043-fdaedf631fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:29.541584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1156/2307] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:42:29 2022] DELETE /identity/v3/projects/04a8e9f1e7c849b4b21ea1259dce85ae => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:29.548098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b14bfe-8145-4dc2-9a4d-c738cffa6c82 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:29.548640 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b14bfe-8145-4dc2-9a4d-c738cffa6c82 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:29.548959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b14bfe-8145-4dc2-9a4d-c738cffa6c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:29.585562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-21b14bfe-8145-4dc2-9a4d-c738cffa6c82 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:29.587232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-21b14bfe-8145-4dc2-9a4d-c738cffa6c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:29.694403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1152/2308] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:29.697245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847b66-0f79-469b-85a4-e5e2df4b7626 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:29.697514 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847b66-0f79-469b-85a4-e5e2df4b7626 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:29.698142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847b66-0f79-469b-85a4-e5e2df4b7626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:29.721427 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ef847b66-0f79-469b-85a4-e5e2df4b7626 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:29.723875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ef847b66-0f79-469b-85a4-e5e2df4b7626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:29.745116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1157/2309] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:29.746746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b14bfe-8145-4dc2-9a4d-c738cffa6c82 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:29.778129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b14bfe-8145-4dc2-9a4d-c738cffa6c82 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:29.785414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71826b-920f-4f18-bf4b-e6f55b27159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:29.786175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71826b-920f-4f18-bf4b-e6f55b27159b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:29.786646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71826b-920f-4f18-bf4b-e6f55b27159b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:29.786990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71826b-920f-4f18-bf4b-e6f55b27159b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:29.788135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71826b-920f-4f18-bf4b-e6f55b27159b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:42:29.788652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71826b-920f-4f18-bf4b-e6f55b27159b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:29.790505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71826b-920f-4f18-bf4b-e6f55b27159b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:29.814968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1153/2310] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:42:29.816441 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847b66-0f79-469b-85a4-e5e2df4b7626 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:29.827822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847b66-0f79-469b-85a4-e5e2df4b7626 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:29.833356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c5ea2-54b8-4e83-acdd-143262ab1dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:29.834059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c5ea2-54b8-4e83-acdd-143262ab1dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:29.834889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c5ea2-54b8-4e83-acdd-143262ab1dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:29.835183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c5ea2-54b8-4e83-acdd-143262ab1dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:29.835901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c5ea2-54b8-4e83-acdd-143262ab1dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:29.837847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c5ea2-54b8-4e83-acdd-143262ab1dd8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:29.898531 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1158/2311] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:42:29 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:29.902845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71826b-920f-4f18-bf4b-e6f55b27159b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:29.917500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71826b-920f-4f18-bf4b-e6f55b27159b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:30.091409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60157-92e5-42bc-b3ce-015c2e54e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:30.092105 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60157-92e5-42bc-b3ce-015c2e54e237 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:30.092571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60157-92e5-42bc-b3ce-015c2e54e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:30.092879 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60157-92e5-42bc-b3ce-015c2e54e237 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:30.093549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd60157-92e5-42bc-b3ce-015c2e54e237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:30.097121 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd60157-92e5-42bc-b3ce-015c2e54e237 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:30.130609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1154/2312] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:42:29 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:30.135131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c5ea2-54b8-4e83-acdd-143262ab1dd8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:30.153065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c5ea2-54b8-4e83-acdd-143262ab1dd8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:30.163276 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e594a-6b37-4b8d-99f2-03860c28216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:30.164064 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e594a-6b37-4b8d-99f2-03860c28216d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:30.164716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e594a-6b37-4b8d-99f2-03860c28216d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:30.165570 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e594a-6b37-4b8d-99f2-03860c28216d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:30.166481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e594a-6b37-4b8d-99f2-03860c28216d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:30.168332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e594a-6b37-4b8d-99f2-03860c28216d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:30.183842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1159/2313] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:30.188166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60157-92e5-42bc-b3ce-015c2e54e237 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:30.206354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60157-92e5-42bc-b3ce-015c2e54e237 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:30.212316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9031a9c-1a0b-49b3-b695-40477946b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:30.213133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9031a9c-1a0b-49b3-b695-40477946b8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:30.213518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9031a9c-1a0b-49b3-b695-40477946b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:30.214215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9031a9c-1a0b-49b3-b695-40477946b8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:30.215357 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9031a9c-1a0b-49b3-b695-40477946b8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:30.233253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9031a9c-1a0b-49b3-b695-40477946b8aa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:30.251982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1155/2314] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:30.257158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e594a-6b37-4b8d-99f2-03860c28216d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:30.271097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e594a-6b37-4b8d-99f2-03860c28216d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:30.280639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9457ce-6a19-4370-871f-75975da086ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:30.282660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9457ce-6a19-4370-871f-75975da086ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:30.283122 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9457ce-6a19-4370-871f-75975da086ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:30.283490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9457ce-6a19-4370-871f-75975da086ec admin admin] PATH_INFO: `/v3/projects/21a9d29f17224774a232218b99165d32/users/b22380932c4e49df935c4424dbe0dc84/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:30.321875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9457ce-6a19-4370-871f-75975da086ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a9d29f17224774a232218b99165d32, user_id=b22380932c4e49df935c4424dbe0dc84, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:30.325858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9457ce-6a19-4370-871f-75975da086ec admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:30.345056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1160/2315] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:30 2022] PUT /identity/v3/projects/21a9d29f17224774a232218b99165d32/users/b22380932c4e49df935c4424dbe0dc84/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:30.351892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c8b77-802f-4804-a301-12a9e38f297d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:30.353034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c8b77-802f-4804-a301-12a9e38f297d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:30.353577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c8b77-802f-4804-a301-12a9e38f297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:30.405728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-841c8b77-802f-4804-a301-12a9e38f297d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:30.408253 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-841c8b77-802f-4804-a301-12a9e38f297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:30.516116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1156/2316] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:42:30.523693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9457ce-6a19-4370-871f-75975da086ec admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:30.527382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5e9457ce-6a19-4370-871f-75975da086ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:30.686092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9457ce-6a19-4370-871f-75975da086ec admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:30.690565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6958a6b-cded-4396-a13c-a1ff44f7574f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:30.691446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958a6b-cded-4396-a13c-a1ff44f7574f service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:30.691793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958a6b-cded-4396-a13c-a1ff44f7574f service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:30.692147 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958a6b-cded-4396-a13c-a1ff44f7574f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:30.710403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958a6b-cded-4396-a13c-a1ff44f7574f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:30.712108 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958a6b-cded-4396-a13c-a1ff44f7574f service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:30.723904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1161/2317] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:31.575734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c8b77-802f-4804-a301-12a9e38f297d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:31.579691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-841c8b77-802f-4804-a301-12a9e38f297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:31.604067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841c8b77-802f-4804-a301-12a9e38f297d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:31.611953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:31.613048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:31.613333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:31.613613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] PATH_INFO: `/v3/users/ce80c3b3df914915a565135e026349ba` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:31.614930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce80c3b3df914915a565135e026349ba)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:31.618199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:31.731050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce80c3b3df914915a565135e026349ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:31.750372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce80c3b3df914915a565135e026349ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:31.801289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce80c3b3df914915a565135e026349ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:31.803828 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce80c3b3df914915a565135e026349ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:31.819573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce80c3b3df914915a565135e026349ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:31.837699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1157/2318] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:42:31 2022] DELETE /identity/v3/users/ce80c3b3df914915a565135e026349ba => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:31.842409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392c900-f5af-40b0-928f-e5aca97ea094 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:31.843195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392c900-f5af-40b0-928f-e5aca97ea094 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:31.843755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392c900-f5af-40b0-928f-e5aca97ea094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:31.870977 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9392c900-f5af-40b0-928f-e5aca97ea094 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:31.872190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9392c900-f5af-40b0-928f-e5aca97ea094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:31.981370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1162/2319] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:31.989397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:31.992423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:32.074707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bad88-f623-48ce-98aa-ef4c5ec38aae admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:32.078848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b823eff-e903-4a1b-a28b-0ded228777fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:32.079498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b823eff-e903-4a1b-a28b-0ded228777fa service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:32.079782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b823eff-e903-4a1b-a28b-0ded228777fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:32.080060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b823eff-e903-4a1b-a28b-0ded228777fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:32.094763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b823eff-e903-4a1b-a28b-0ded228777fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:32.096626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b823eff-e903-4a1b-a28b-0ded228777fa service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:32.111219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1158/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:32.622278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392c900-f5af-40b0-928f-e5aca97ea094 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:32.625246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9392c900-f5af-40b0-928f-e5aca97ea094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:32.663323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392c900-f5af-40b0-928f-e5aca97ea094 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:32.683320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:32.685040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:32.685318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:32.685580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] PATH_INFO: `/v3/projects/2522ca4f15014980bf5f860bd0e04d97` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:32.686848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2522ca4f15014980bf5f860bd0e04d97)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:32.696820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:32.757193 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2522ca4f15014980bf5f860bd0e04d97', 'request_id': 'req-eb8c7eef-fb70-491f-b872-a821f1e9a137'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:32.776136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2522ca4f15014980bf5f860bd0e04d97', 'request_id': 'req-eb8c7eef-fb70-491f-b872-a821f1e9a137'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:32.790030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2522ca4f15014980bf5f860bd0e04d97', 'request_id': 'req-eb8c7eef-fb70-491f-b872-a821f1e9a137'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:32.821150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] The token cache is being invalidate because project 2522ca4f15014980bf5f860bd0e04d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:42:32.821753 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:32.822961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:32.836211 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1163/2321] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:42:32 2022] DELETE /identity/v3/projects/2522ca4f15014980bf5f860bd0e04d97 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:32.840551 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b823eff-e903-4a1b-a28b-0ded228777fa service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:32.853024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b823eff-e903-4a1b-a28b-0ded228777fa service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:32.999745 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:33.000972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:33.001405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:33.001855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] PATH_INFO: `/v3/users/3615eab075e441daae45707f59c3828b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:33.003272 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3615eab075e441daae45707f59c3828b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:33.005575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:33.075929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3615eab075e441daae45707f59c3828b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:33.083249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3615eab075e441daae45707f59c3828b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:33.097044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3615eab075e441daae45707f59c3828b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:33.098020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3615eab075e441daae45707f59c3828b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:33.107638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3615eab075e441daae45707f59c3828b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:33.117314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1159/2322] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:42:32 2022] DELETE /identity/v3/users/3615eab075e441daae45707f59c3828b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:33.944239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:33.945826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:33.961682 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c7eef-fb70-491f-b872-a821f1e9a137 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:34.088332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:34.089370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:34.089744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:34.090090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] PATH_INFO: `/v3/projects/39d1f073d5e84db2980930051ac81e4f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:34.091472 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d1f073d5e84db2980930051ac81e4f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:34.093707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:34.192414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d1f073d5e84db2980930051ac81e4f', 'request_id': 'req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.199979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d1f073d5e84db2980930051ac81e4f', 'request_id': 'req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.209280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d1f073d5e84db2980930051ac81e4f', 'request_id': 'req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.223793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] The token cache is being invalidate because project 39d1f073d5e84db2980930051ac81e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:42:34.224176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.225504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.227533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1164/2323] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:42:33 2022] DELETE /identity/v3/projects/39d1f073d5e84db2980930051ac81e4f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:34.236373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:34.238071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:34.257620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695da3f-b4d6-4eba-8b8f-5e7356b55eca admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:34.344231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:34.346072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:34.346639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:34.347111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] PATH_INFO: `/v3/users/d4a24cd59aa44fde9a476f12598e3cb5` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:34.349009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a24cd59aa44fde9a476f12598e3cb5)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:34.352891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:34.441385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a24cd59aa44fde9a476f12598e3cb5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.459729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a24cd59aa44fde9a476f12598e3cb5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.490952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a24cd59aa44fde9a476f12598e3cb5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.492486 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a24cd59aa44fde9a476f12598e3cb5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.517129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4ad612e5-2f8c-4aef-a490-f2f29aa53ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a24cd59aa44fde9a476f12598e3cb5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:34.543730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1160/2324] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:42:34 2022] DELETE /identity/v3/users/d4a24cd59aa44fde9a476f12598e3cb5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:35.694741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:35.697377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:35.727826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4d1aa-5403-42de-9113-b1d7bd8bd27e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:35.893505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:35.895164 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:35.895455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:35.895889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] PATH_INFO: `/v3/projects/d332ae79487846ee9ce2b560e1a3c686` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:35.897695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d332ae79487846ee9ce2b560e1a3c686)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:35.901432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:36.012966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd332ae79487846ee9ce2b560e1a3c686', 'request_id': 'req-60f4091d-6148-42a1-9fc5-df50385ca193'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:36.034488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd332ae79487846ee9ce2b560e1a3c686', 'request_id': 'req-60f4091d-6148-42a1-9fc5-df50385ca193'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:36.050979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd332ae79487846ee9ce2b560e1a3c686', 'request_id': 'req-60f4091d-6148-42a1-9fc5-df50385ca193'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:36.071724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] The token cache is being invalidate because project d332ae79487846ee9ce2b560e1a3c686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:42:36.072023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:36.077439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:42:36.079638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1165/2325] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:42:35 2022] DELETE /identity/v3/projects/d332ae79487846ee9ce2b560e1a3c686 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:37.604839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e2438-c155-4911-90e8-97e298455979 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:37.605337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e2438-c155-4911-90e8-97e298455979 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:37.605664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e2438-c155-4911-90e8-97e298455979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:37.643955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5a8e2438-c155-4911-90e8-97e298455979 None None] MFA Rules not processed for user `b22380932c4e49df935c4424dbe0dc84`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:37.647100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5a8e2438-c155-4911-90e8-97e298455979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:37.741764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1161/2326] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:37.746100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:37.747518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:37.816862 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4091d-6148-42a1-9fc5-df50385ca193 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:37.822250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ff01-8e92-414a-876d-a37bc2f238fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:37.823162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ff01-8e92-414a-876d-a37bc2f238fe admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:37.823443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ff01-8e92-414a-876d-a37bc2f238fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:37.823715 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ff01-8e92-414a-876d-a37bc2f238fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:37.824469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109ff01-8e92-414a-876d-a37bc2f238fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:37.826379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109ff01-8e92-414a-876d-a37bc2f238fe admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:37.855881 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1166/2327] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:42:37 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:42:37.857034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e2438-c155-4911-90e8-97e298455979 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:37.872091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e2438-c155-4911-90e8-97e298455979 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:37.931787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197214b-c314-418c-aa1c-bb102e816cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:37.932581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197214b-c314-418c-aa1c-bb102e816cad admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:37.932941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197214b-c314-418c-aa1c-bb102e816cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:37.933227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197214b-c314-418c-aa1c-bb102e816cad admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:37.933924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197214b-c314-418c-aa1c-bb102e816cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:37.935937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197214b-c314-418c-aa1c-bb102e816cad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:37.958530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1162/2328] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:42:37 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:42:37.962901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ff01-8e92-414a-876d-a37bc2f238fe admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:37.973365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ff01-8e92-414a-876d-a37bc2f238fe admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:37.978983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe6162-c89a-432d-9982-2a4ee0f94f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:37.979729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe6162-c89a-432d-9982-2a4ee0f94f8c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:37.980131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe6162-c89a-432d-9982-2a4ee0f94f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:37.980462 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe6162-c89a-432d-9982-2a4ee0f94f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:37.981165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe6162-c89a-432d-9982-2a4ee0f94f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:37.982856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe6162-c89a-432d-9982-2a4ee0f94f8c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:37.994941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1167/2329] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:37.999183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197214b-c314-418c-aa1c-bb102e816cad admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:38.010972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197214b-c314-418c-aa1c-bb102e816cad admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:38.016678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a703-8f3b-41e8-ba2c-c8af11976bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:38.017562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a703-8f3b-41e8-ba2c-c8af11976bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:38.017848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a703-8f3b-41e8-ba2c-c8af11976bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:38.018119 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a703-8f3b-41e8-ba2c-c8af11976bfc admin admin] PATH_INFO: `/v3/projects/dda52da4a9244401ae747dcfb7534442/users/b20673af8c274f63afedc4561704448c/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:38.035562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a703-8f3b-41e8-ba2c-c8af11976bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda52da4a9244401ae747dcfb7534442, user_id=b20673af8c274f63afedc4561704448c, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:38.038956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a703-8f3b-41e8-ba2c-c8af11976bfc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:38.056667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1163/2330] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:37 2022] PUT /identity/v3/projects/dda52da4a9244401ae747dcfb7534442/users/b20673af8c274f63afedc4561704448c/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:42:38.061455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe6162-c89a-432d-9982-2a4ee0f94f8c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:38.071747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe6162-c89a-432d-9982-2a4ee0f94f8c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:38.139879 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea18e63-4535-4c73-b086-40ac347e4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:38.140561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea18e63-4535-4c73-b086-40ac347e4767 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:38.140842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea18e63-4535-4c73-b086-40ac347e4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:38.141112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea18e63-4535-4c73-b086-40ac347e4767 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:38.141848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea18e63-4535-4c73-b086-40ac347e4767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:38.143530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea18e63-4535-4c73-b086-40ac347e4767 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:38.160768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1168/2331] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:42:38.164636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a703-8f3b-41e8-ba2c-c8af11976bfc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:38.175754 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a703-8f3b-41e8-ba2c-c8af11976bfc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:38.181209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c7e27-b1e7-4110-a57a-6d70b437ee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:38.182252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7e27-b1e7-4110-a57a-6d70b437ee40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:38.182532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7e27-b1e7-4110-a57a-6d70b437ee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:38.182946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c7e27-b1e7-4110-a57a-6d70b437ee40 admin admin] PATH_INFO: `/v3/projects/dda52da4a9244401ae747dcfb7534442/users/b20673af8c274f63afedc4561704448c/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:38.195628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c7e27-b1e7-4110-a57a-6d70b437ee40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda52da4a9244401ae747dcfb7534442, user_id=b20673af8c274f63afedc4561704448c, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:38.198797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c7e27-b1e7-4110-a57a-6d70b437ee40 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:38.210113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1164/2332] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:42:38 2022] PUT /identity/v3/projects/dda52da4a9244401ae747dcfb7534442/users/b20673af8c274f63afedc4561704448c/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:42:44.863260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125bc6e-a990-4b1e-a7ce-ac70cc6e559c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:44.865518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125bc6e-a990-4b1e-a7ce-ac70cc6e559c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:44.865809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125bc6e-a990-4b1e-a7ce-ac70cc6e559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:44.889628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f125bc6e-a990-4b1e-a7ce-ac70cc6e559c None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:44.891037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f125bc6e-a990-4b1e-a7ce-ac70cc6e559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:45.050813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1169/2333] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:42:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:45.114111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c7e27-b1e7-4110-a57a-6d70b437ee40 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:45.118627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-be4c7e27-b1e7-4110-a57a-6d70b437ee40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:45.234245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c7e27-b1e7-4110-a57a-6d70b437ee40 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:45.245448 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0a04-22da-4a8e-8c16-b56e8c0ec6fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:45.246118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0a04-22da-4a8e-8c16-b56e8c0ec6fe service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:45.246392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0a04-22da-4a8e-8c16-b56e8c0ec6fe service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:45.246850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0a04-22da-4a8e-8c16-b56e8c0ec6fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:45.257645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb0a04-22da-4a8e-8c16-b56e8c0ec6fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:45.259708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb0a04-22da-4a8e-8c16-b56e8c0ec6fe service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:45.280719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1165/2334] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:42:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:42:45.432918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e0459-38a2-4909-a891-b90a1e00ce9a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:45.433206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e0459-38a2-4909-a891-b90a1e00ce9a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:45.433501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e0459-38a2-4909-a891-b90a1e00ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:45.474995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7e3e0459-38a2-4909-a891-b90a1e00ce9a None None] MFA Rules not processed for user `b20673af8c274f63afedc4561704448c`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:45.476223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7e3e0459-38a2-4909-a891-b90a1e00ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:45.575635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1170/2335] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:45.587451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0a04-22da-4a8e-8c16-b56e8c0ec6fe service swift] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:45.589042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2ecb0a04-22da-4a8e-8c16-b56e8c0ec6fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:45.687719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0a04-22da-4a8e-8c16-b56e8c0ec6fe service swift] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:45.698578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa9f5a-60bb-466c-9c90-a34fc2c1f2eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:45.699469 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa9f5a-60bb-466c-9c90-a34fc2c1f2eb service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:45.699861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa9f5a-60bb-466c-9c90-a34fc2c1f2eb service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:45.700248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa9f5a-60bb-466c-9c90-a34fc2c1f2eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:45.801884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa9f5a-60bb-466c-9c90-a34fc2c1f2eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:45.804429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa9f5a-60bb-466c-9c90-a34fc2c1f2eb service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:45.815747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1166/2336] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:42:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:42:47.776662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839adf69-b0ce-42ec-9069-746010411683 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:47.777176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839adf69-b0ce-42ec-9069-746010411683 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:47.777370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839adf69-b0ce-42ec-9069-746010411683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:47.811000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-839adf69-b0ce-42ec-9069-746010411683 None None] MFA Rules not processed for user `b22380932c4e49df935c4424dbe0dc84`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:47.812326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-839adf69-b0ce-42ec-9069-746010411683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:47.825635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1171/2337] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:50.592946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc36ec-82ab-41b0-be99-7c42121abcde None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:50.593517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc36ec-82ab-41b0-be99-7c42121abcde None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:50.593517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc36ec-82ab-41b0-be99-7c42121abcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:50.650347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-38bc36ec-82ab-41b0-be99-7c42121abcde None None] MFA Rules not processed for user `f182c5215d37423da1a00cbb98757957`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:50.651591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-38bc36ec-82ab-41b0-be99-7c42121abcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:50.745688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1167/2338] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:42:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:57.785928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7726131-6b57-4407-8d39-edc6343d946e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:57.787015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7726131-6b57-4407-8d39-edc6343d946e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:57.787743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7726131-6b57-4407-8d39-edc6343d946e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:57.815060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d7726131-6b57-4407-8d39-edc6343d946e None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:42:57.816918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d7726131-6b57-4407-8d39-edc6343d946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:42:57.834464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1172/2339] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:42:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:42:57.852758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc36ec-82ab-41b0-be99-7c42121abcde None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:42:57.868312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc36ec-82ab-41b0-be99-7c42121abcde None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:42:57.873688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e0a04-4c2b-477c-91e7-e1d48ffe472f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:42:57.874429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0a04-4c2b-477c-91e7-e1d48ffe472f service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:42:57.874778 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0a04-4c2b-477c-91e7-e1d48ffe472f service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:42:57.875145 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e0a04-4c2b-477c-91e7-e1d48ffe472f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:42:57.885039 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e0a04-4c2b-477c-91e7-e1d48ffe472f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:42:57.886674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e0a04-4c2b-477c-91e7-e1d48ffe472f service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:42:57.899092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1168/2340] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:42:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:43:06.808519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518af0-d3b5-45e6-81fb-191b2c2667d9 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:06.809070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518af0-d3b5-45e6-81fb-191b2c2667d9 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:06.809070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518af0-d3b5-45e6-81fb-191b2c2667d9 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:06.811360 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1173/2341] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:43:06.818031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99aba9-5bba-4693-a69f-7ac3644065bf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:06.818587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99aba9-5bba-4693-a69f-7ac3644065bf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:06.818914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99aba9-5bba-4693-a69f-7ac3644065bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:06.846128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-cb99aba9-5bba-4693-a69f-7ac3644065bf None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:06.847777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cb99aba9-5bba-4693-a69f-7ac3644065bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:06.859982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1169/2342] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:43:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:43:06.878460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518af0-d3b5-45e6-81fb-191b2c2667d9 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:06.880841 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-31518af0-d3b5-45e6-81fb-191b2c2667d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:06.979946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518af0-d3b5-45e6-81fb-191b2c2667d9 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:06.995169 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aeeda-6cb3-472f-b8ff-e8ab5ee4d3a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '612a02fb42af490abcba0e75ec8c759f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:06.995834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aeeda-6cb3-472f-b8ff-e8ab5ee4d3a8 service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:06.996402 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aeeda-6cb3-472f-b8ff-e8ab5ee4d3a8 service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:06.996912 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aeeda-6cb3-472f-b8ff-e8ab5ee4d3a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:07.009375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915aeeda-6cb3-472f-b8ff-e8ab5ee4d3a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:07.011451 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915aeeda-6cb3-472f-b8ff-e8ab5ee4d3a8 service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:07.026946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1174/2343] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:07.131998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aa04a-fed9-4811-91ba-3793a3ce7f5e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:07.132732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aa04a-fed9-4811-91ba-3793a3ce7f5e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:07.133281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aa04a-fed9-4811-91ba-3793a3ce7f5e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:07.135219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1170/2344] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:43:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:43:07.141036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7ae9-744f-49d8-b985-c111654bcde1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:07.141333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7ae9-744f-49d8-b985-c111654bcde1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:07.141596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa7ae9-744f-49d8-b985-c111654bcde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:07.164490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-fcaa7ae9-744f-49d8-b985-c111654bcde1 None None] MFA Rules not processed for user `b3922641f7c846da98457824bec58652`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:07.165722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fcaa7ae9-744f-49d8-b985-c111654bcde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:07.268789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1175/2345] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:43:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:07.273240 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aa04a-fed9-4811-91ba-3793a3ce7f5e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:07.275366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-410aa04a-fed9-4811-91ba-3793a3ce7f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:07.298187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410aa04a-fed9-4811-91ba-3793a3ce7f5e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:07.307330 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1650618-03f3-4d67-a4d4-c17197d2101e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:07.308281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1650618-03f3-4d67-a4d4-c17197d2101e service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:07.308616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1650618-03f3-4d67-a4d4-c17197d2101e service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:07.308888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1650618-03f3-4d67-a4d4-c17197d2101e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:07.327078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1650618-03f3-4d67-a4d4-c17197d2101e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:07.329313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1650618-03f3-4d67-a4d4-c17197d2101e service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:07.347203 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1171/2346] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:09.587638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7ae9-744f-49d8-b985-c111654bcde1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:09.591825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fcaa7ae9-744f-49d8-b985-c111654bcde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:09.615362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa7ae9-744f-49d8-b985-c111654bcde1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:09.626475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314ca07-0577-4fae-ba2a-7d52bb119627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:09.627148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314ca07-0577-4fae-ba2a-7d52bb119627 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:09.627421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314ca07-0577-4fae-ba2a-7d52bb119627 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:09.627690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314ca07-0577-4fae-ba2a-7d52bb119627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:09.630765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4314ca07-0577-4fae-ba2a-7d52bb119627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:09.849856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314ca07-0577-4fae-ba2a-7d52bb119627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:09.851644 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314ca07-0577-4fae-ba2a-7d52bb119627 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:09.863154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1176/2347] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:11.179055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79743a4b-cc7e-4641-a0b0-980788f2e7c1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:11.179924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79743a4b-cc7e-4641-a0b0-980788f2e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:11.180455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79743a4b-cc7e-4641-a0b0-980788f2e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:11.205077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-79743a4b-cc7e-4641-a0b0-980788f2e7c1 None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:11.206818 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-79743a4b-cc7e-4641-a0b0-980788f2e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:11.223971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1172/2348] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:43:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:11.231081 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314ca07-0577-4fae-ba2a-7d52bb119627 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:11.247382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314ca07-0577-4fae-ba2a-7d52bb119627 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:11.273214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06864682-695d-4a8c-9869-b68223bc1b53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:11.274140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06864682-695d-4a8c-9869-b68223bc1b53 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:11.274420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06864682-695d-4a8c-9869-b68223bc1b53 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:11.274744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06864682-695d-4a8c-9869-b68223bc1b53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:11.285765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06864682-695d-4a8c-9869-b68223bc1b53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:11.288489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06864682-695d-4a8c-9869-b68223bc1b53 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:11.302470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1177/2349] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:43:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:43:19.207076 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e5a7d-314f-460d-ba80-cc793a59f156 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:19.208593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e5a7d-314f-460d-ba80-cc793a59f156 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:19.209038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e5a7d-314f-460d-ba80-cc793a59f156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:19.227189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-dd5e5a7d-314f-460d-ba80-cc793a59f156 None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:19.228851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dd5e5a7d-314f-460d-ba80-cc793a59f156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:19.236267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1173/2350] 10.222.0.15 () {58 vars in 967 bytes} [Mon Feb 7 02:43:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:19.257363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06864682-695d-4a8c-9869-b68223bc1b53 service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:19.268473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06864682-695d-4a8c-9869-b68223bc1b53 service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:19.274687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83fdda-8f43-42f0-8242-58c78cc2b7f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:19.275329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83fdda-8f43-42f0-8242-58c78cc2b7f5 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:19.275608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83fdda-8f43-42f0-8242-58c78cc2b7f5 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:19.275880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83fdda-8f43-42f0-8242-58c78cc2b7f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:19.284405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83fdda-8f43-42f0-8242-58c78cc2b7f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:19.286015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83fdda-8f43-42f0-8242-58c78cc2b7f5 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:19.294121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1178/2351] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:43:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:43:21.730143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e5a7d-314f-460d-ba80-cc793a59f156 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:21.731796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dd5e5a7d-314f-460d-ba80-cc793a59f156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:21.897151 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e5a7d-314f-460d-ba80-cc793a59f156 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:21.902600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:21.903696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:21.904167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:21.904487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] PATH_INFO: `/v3/users/9ba5c9aad52e4bfebae6958009e2f32f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:21.905769 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba5c9aad52e4bfebae6958009e2f32f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:21.913056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:22.002419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba5c9aad52e4bfebae6958009e2f32f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.021412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba5c9aad52e4bfebae6958009e2f32f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.035106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba5c9aad52e4bfebae6958009e2f32f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.036993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba5c9aad52e4bfebae6958009e2f32f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.048446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c9858e02-c822-4bde-8ff8-7c80ec24a68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba5c9aad52e4bfebae6958009e2f32f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.059013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1174/2352] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:43:21 2022] DELETE /identity/v3/users/9ba5c9aad52e4bfebae6958009e2f32f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:22.260429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83fdda-8f43-42f0-8242-58c78cc2b7f5 service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:22.319270 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83fdda-8f43-42f0-8242-58c78cc2b7f5 service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:22.384624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:22.385706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:22.386285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:22.386763 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] PATH_INFO: `/v3/projects/389892796f3c4135a8d442afe846612a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:22.388162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389892796f3c4135a8d442afe846612a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:22.390109 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:22.438575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389892796f3c4135a8d442afe846612a', 'request_id': 'req-534f9d70-4f28-482b-b0bc-94e1f9402b77'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.444908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389892796f3c4135a8d442afe846612a', 'request_id': 'req-534f9d70-4f28-482b-b0bc-94e1f9402b77'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.452672 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389892796f3c4135a8d442afe846612a', 'request_id': 'req-534f9d70-4f28-482b-b0bc-94e1f9402b77'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.464403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] The token cache is being invalidate because project 389892796f3c4135a8d442afe846612a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:43:22.464853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.465537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-534f9d70-4f28-482b-b0bc-94e1f9402b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:22.471393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1179/2353] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:43:22 2022] DELETE /identity/v3/projects/389892796f3c4135a8d442afe846612a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:22.474035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e19aff-1329-477f-bbb3-749612bc471d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:22.474396 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e19aff-1329-477f-bbb3-749612bc471d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:22.474742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e19aff-1329-477f-bbb3-749612bc471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:22.525521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-24e19aff-1329-477f-bbb3-749612bc471d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:22.526790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-24e19aff-1329-477f-bbb3-749612bc471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:22.590056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1175/2354] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:43:22.604390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec63d8-ee73-4d2b-9d68-c3431f18a0d4 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:22.604390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec63d8-ee73-4d2b-9d68-c3431f18a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:22.604390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec63d8-ee73-4d2b-9d68-c3431f18a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:22.642650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-00ec63d8-ee73-4d2b-9d68-c3431f18a0d4 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:22.651658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-00ec63d8-ee73-4d2b-9d68-c3431f18a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:22.702357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1180/2355] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:22.703783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e19aff-1329-477f-bbb3-749612bc471d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:22.728402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e19aff-1329-477f-bbb3-749612bc471d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:22.733265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e474c-fca9-499e-9add-07c8ca1aea1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:22.733967 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e474c-fca9-499e-9add-07c8ca1aea1e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:22.734246 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e474c-fca9-499e-9add-07c8ca1aea1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:22.734518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e474c-fca9-499e-9add-07c8ca1aea1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:22.735246 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e474c-fca9-499e-9add-07c8ca1aea1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:43:22.735546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e474c-fca9-499e-9add-07c8ca1aea1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:22.737156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e474c-fca9-499e-9add-07c8ca1aea1e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:22.752389 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1176/2356] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:43:22.753854 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec63d8-ee73-4d2b-9d68-c3431f18a0d4 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:22.764246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec63d8-ee73-4d2b-9d68-c3431f18a0d4 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:22.771303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b696ae8-2dd4-4f0b-99aa-02d8974716be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:22.771990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b696ae8-2dd4-4f0b-99aa-02d8974716be admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:22.772257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b696ae8-2dd4-4f0b-99aa-02d8974716be admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:22.772558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b696ae8-2dd4-4f0b-99aa-02d8974716be admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:22.773284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b696ae8-2dd4-4f0b-99aa-02d8974716be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:22.775269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b696ae8-2dd4-4f0b-99aa-02d8974716be admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:22.814923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1181/2357] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:43:22 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:43:22.817957 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e474c-fca9-499e-9add-07c8ca1aea1e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:22.834312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e474c-fca9-499e-9add-07c8ca1aea1e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:22.931298 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae2464-5f4c-486c-8fd8-a1a626661c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:22.932886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae2464-5f4c-486c-8fd8-a1a626661c39 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:22.933180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae2464-5f4c-486c-8fd8-a1a626661c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:22.933466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae2464-5f4c-486c-8fd8-a1a626661c39 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:22.934186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae2464-5f4c-486c-8fd8-a1a626661c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:22.936136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae2464-5f4c-486c-8fd8-a1a626661c39 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:22.994414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1177/2358] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:43:22 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:43:22.998187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b696ae8-2dd4-4f0b-99aa-02d8974716be admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:23.009847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b696ae8-2dd4-4f0b-99aa-02d8974716be admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:23.014692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989618de-3ee2-4e8c-bc85-7977986167c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:23.015369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989618de-3ee2-4e8c-bc85-7977986167c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:23.015796 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989618de-3ee2-4e8c-bc85-7977986167c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:23.016078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989618de-3ee2-4e8c-bc85-7977986167c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:23.017060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989618de-3ee2-4e8c-bc85-7977986167c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:23.018661 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989618de-3ee2-4e8c-bc85-7977986167c1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:23.032395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1182/2359] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:43:23.035098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae2464-5f4c-486c-8fd8-a1a626661c39 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:23.045440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae2464-5f4c-486c-8fd8-a1a626661c39 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:23.050088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9a857-3ba1-4de8-ab67-8355f0b48e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:23.050750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a857-3ba1-4de8-ab67-8355f0b48e49 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:23.051059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a857-3ba1-4de8-ab67-8355f0b48e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:23.051334 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a857-3ba1-4de8-ab67-8355f0b48e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:23.056999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9a857-3ba1-4de8-ab67-8355f0b48e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:23.060182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9a857-3ba1-4de8-ab67-8355f0b48e49 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:23.076638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1178/2360] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:23.077722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989618de-3ee2-4e8c-bc85-7977986167c1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:23.090666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989618de-3ee2-4e8c-bc85-7977986167c1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:23.099096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed312f03-dc55-4c93-8c7e-de2136d812f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:23.099990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed312f03-dc55-4c93-8c7e-de2136d812f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:23.100269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed312f03-dc55-4c93-8c7e-de2136d812f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:23.100667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed312f03-dc55-4c93-8c7e-de2136d812f7 admin admin] PATH_INFO: `/v3/projects/4cc0a066776349848e07e28a79e43871/users/92f4a8bb9b7c42b09b79fd5a56af9bcb/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:23.120960 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed312f03-dc55-4c93-8c7e-de2136d812f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc0a066776349848e07e28a79e43871, user_id=92f4a8bb9b7c42b09b79fd5a56af9bcb, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:23.124044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed312f03-dc55-4c93-8c7e-de2136d812f7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:23.143904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1183/2361] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:43:23 2022] PUT /identity/v3/projects/4cc0a066776349848e07e28a79e43871/users/92f4a8bb9b7c42b09b79fd5a56af9bcb/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:23.149564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853f92-2c4a-42ce-a53f-95a2ec260930 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:23.150035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853f92-2c4a-42ce-a53f-95a2ec260930 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:23.150388 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5853f92-2c4a-42ce-a53f-95a2ec260930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:23.173611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f5853f92-2c4a-42ce-a53f-95a2ec260930 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:23.175030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f5853f92-2c4a-42ce-a53f-95a2ec260930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:23.257684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1179/2362] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:23.272305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed312f03-dc55-4c93-8c7e-de2136d812f7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:23.274174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ed312f03-dc55-4c93-8c7e-de2136d812f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:23.385409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed312f03-dc55-4c93-8c7e-de2136d812f7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:23.389204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcce2f-9b96-4e2e-b637-ca7a651c9fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:23.389854 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcce2f-9b96-4e2e-b637-ca7a651c9fde service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:23.390138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcce2f-9b96-4e2e-b637-ca7a651c9fde service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:23.390414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcce2f-9b96-4e2e-b637-ca7a651c9fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:23.399871 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcce2f-9b96-4e2e-b637-ca7a651c9fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:23.401346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcce2f-9b96-4e2e-b637-ca7a651c9fde service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:23.410889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1184/2363] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:23.990687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75252-5fa1-433a-98d1-7308d7506178 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:23.991202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75252-5fa1-433a-98d1-7308d7506178 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:23.991393 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75252-5fa1-433a-98d1-7308d7506178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:24.023321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-39d75252-5fa1-433a-98d1-7308d7506178 None None] MFA Rules not processed for user `92f4a8bb9b7c42b09b79fd5a56af9bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:24.024576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-39d75252-5fa1-433a-98d1-7308d7506178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:24.091855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1180/2364] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:24.101843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcce2f-9b96-4e2e-b637-ca7a651c9fde service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:24.103290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-99bcce2f-9b96-4e2e-b637-ca7a651c9fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:24.167222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcce2f-9b96-4e2e-b637-ca7a651c9fde service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:24.171573 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd5aaa-583f-4712-915a-489917a92485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:24.172297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd5aaa-583f-4712-915a-489917a92485 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:24.172676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd5aaa-583f-4712-915a-489917a92485 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:24.173024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd5aaa-583f-4712-915a-489917a92485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:24.182859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd5aaa-583f-4712-915a-489917a92485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:24.184371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd5aaa-583f-4712-915a-489917a92485 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:24.193209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1185/2365] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:43:25.529598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501ed6e-7d16-4d26-a484-ef1fb76c19f5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:25.530125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501ed6e-7d16-4d26-a484-ef1fb76c19f5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:25.530282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501ed6e-7d16-4d26-a484-ef1fb76c19f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:25.549211 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4501ed6e-7d16-4d26-a484-ef1fb76c19f5 None None] MFA Rules not processed for user `92f4a8bb9b7c42b09b79fd5a56af9bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:25.550423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4501ed6e-7d16-4d26-a484-ef1fb76c19f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:25.557688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1181/2366] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:31.554244 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd5aaa-583f-4712-915a-489917a92485 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:31.563154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd5aaa-583f-4712-915a-489917a92485 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:31.566759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827f2bc-a9ea-4530-a420-d1e3b7321642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:31.567419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827f2bc-a9ea-4530-a420-d1e3b7321642 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:31.567699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827f2bc-a9ea-4530-a420-d1e3b7321642 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:31.567968 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827f2bc-a9ea-4530-a420-d1e3b7321642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:31.569752 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7827f2bc-a9ea-4530-a420-d1e3b7321642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:31.633150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827f2bc-a9ea-4530-a420-d1e3b7321642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:31.634595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827f2bc-a9ea-4530-a420-d1e3b7321642 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:31.644039 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1186/2367] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:38.692046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd1ca-e46d-42af-a933-e0441f3dc303 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:38.693107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd1ca-e46d-42af-a933-e0441f3dc303 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:38.693202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cd1ca-e46d-42af-a933-e0441f3dc303 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:38.694943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1182/2368] 10.222.0.15 () {54 vars in 960 bytes} [Mon Feb 7 02:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:43:38.700740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c664f2a-d454-4601-b57c-7e007a292211 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:38.701226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c664f2a-d454-4601-b57c-7e007a292211 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:38.701425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c664f2a-d454-4601-b57c-7e007a292211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:38.720773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8c664f2a-d454-4601-b57c-7e007a292211 None None] MFA Rules not processed for user `b06b37b8f23946ebbb5083a877274ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:38.722196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8c664f2a-d454-4601-b57c-7e007a292211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:38.789467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1187/2369] 10.222.0.15 () {58 vars in 1057 bytes} [Mon Feb 7 02:43:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:38.797011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd1ca-e46d-42af-a933-e0441f3dc303 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:38.812224 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cd1ca-e46d-42af-a933-e0441f3dc303 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:38.818078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06b37b8f23946ebbb5083a877274ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:38.819149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:38.819829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:38.820228 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:38.822269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:38.842279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:38.844172 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:38.855955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1183/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:40.774696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b033df7-bcb5-4a43-b8c9-cb72a6a4d139 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:40.775191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b033df7-bcb5-4a43-b8c9-cb72a6a4d139 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:40.775289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b033df7-bcb5-4a43-b8c9-cb72a6a4d139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:40.799783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5b033df7-bcb5-4a43-b8c9-cb72a6a4d139 None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:40.801197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5b033df7-bcb5-4a43-b8c9-cb72a6a4d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:40.860547 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1188/2371] 10.222.0.15 () {58 vars in 967 bytes} [Mon Feb 7 02:43:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:40.871701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:40.873358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:40.942589 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c0b29-f204-402b-a515-f2c8b55248b9 service placement] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:40.947902 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fca489-b2a9-4cf4-bce4-5d4dc9058ce3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:40.948608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fca489-b2a9-4cf4-bce4-5d4dc9058ce3 service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:40.948891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fca489-b2a9-4cf4-bce4-5d4dc9058ce3 service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:40.949165 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fca489-b2a9-4cf4-bce4-5d4dc9058ce3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:40.957594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fca489-b2a9-4cf4-bce4-5d4dc9058ce3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:40.959061 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fca489-b2a9-4cf4-bce4-5d4dc9058ce3 service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:40.968522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1184/2372] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:43:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:43:53.264761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b033df7-bcb5-4a43-b8c9-cb72a6a4d139 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:53.266499 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5b033df7-bcb5-4a43-b8c9-cb72a6a4d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:53.284060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b033df7-bcb5-4a43-b8c9-cb72a6a4d139 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:53.289638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:53.290691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:53.291166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:53.291568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] PATH_INFO: `/v3/users/4197ebc1386c48e99fc150f70a1f8537` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:53.293006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4197ebc1386c48e99fc150f70a1f8537)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:53.294957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:53.345379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4197ebc1386c48e99fc150f70a1f8537'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.355082 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4197ebc1386c48e99fc150f70a1f8537'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.362013 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4197ebc1386c48e99fc150f70a1f8537'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.373355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4197ebc1386c48e99fc150f70a1f8537'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.373987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f36bbb53-3919-4d66-8713-ce16d266f516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4197ebc1386c48e99fc150f70a1f8537'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.379692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1189/2373] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:43:53 2022] DELETE /identity/v3/users/4197ebc1386c48e99fc150f70a1f8537 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:53.556291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fca489-b2a9-4cf4-bce4-5d4dc9058ce3 service swift] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:53.567054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fca489-b2a9-4cf4-bce4-5d4dc9058ce3 service swift] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:53.621795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:53.622646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:53.622920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:53.623189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] PATH_INFO: `/v3/projects/b420d6a75bee4f108d3d5e3723db3f97` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:53.624435 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b420d6a75bee4f108d3d5e3723db3f97)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:53.626385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:53.670541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b420d6a75bee4f108d3d5e3723db3f97', 'request_id': 'req-ad51d6e7-60d3-427d-b15c-82b352b39619'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.676680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b420d6a75bee4f108d3d5e3723db3f97', 'request_id': 'req-ad51d6e7-60d3-427d-b15c-82b352b39619'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.682056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b420d6a75bee4f108d3d5e3723db3f97', 'request_id': 'req-ad51d6e7-60d3-427d-b15c-82b352b39619'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.695644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] The token cache is being invalidate because project b420d6a75bee4f108d3d5e3723db3f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:43:53.695932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.696581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ad51d6e7-60d3-427d-b15c-82b352b39619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:53.698380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1185/2374] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:43:53 2022] DELETE /identity/v3/projects/b420d6a75bee4f108d3d5e3723db3f97 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:53.704102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02562bb-d4cf-4475-9857-a07bae99dfe6 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:53.704449 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02562bb-d4cf-4475-9857-a07bae99dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:53.704734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02562bb-d4cf-4475-9857-a07bae99dfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:53.732721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e02562bb-d4cf-4475-9857-a07bae99dfe6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:53.733953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e02562bb-d4cf-4475-9857-a07bae99dfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:53.789923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1190/2375] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:53.797402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b37b8-84f8-4bcc-8bd2-cd97a7b57b2d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:53.797692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b37b8-84f8-4bcc-8bd2-cd97a7b57b2d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:53.797969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b37b8-84f8-4bcc-8bd2-cd97a7b57b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:53.815834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-288b37b8-84f8-4bcc-8bd2-cd97a7b57b2d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:53.816974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-288b37b8-84f8-4bcc-8bd2-cd97a7b57b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:53.825596 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1186/2376] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:43:53.829751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02562bb-d4cf-4475-9857-a07bae99dfe6 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:53.839930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02562bb-d4cf-4475-9857-a07bae99dfe6 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:53.844578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262dd27-73b4-4f4a-b70c-c5dbd4db15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:53.845231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262dd27-73b4-4f4a-b70c-c5dbd4db15be admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:53.845507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262dd27-73b4-4f4a-b70c-c5dbd4db15be admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:53.845781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262dd27-73b4-4f4a-b70c-c5dbd4db15be admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:53.846516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262dd27-73b4-4f4a-b70c-c5dbd4db15be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:43:53.846814 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262dd27-73b4-4f4a-b70c-c5dbd4db15be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:53.848434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262dd27-73b4-4f4a-b70c-c5dbd4db15be admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:53.860420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1191/2377] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:43:53.865245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b37b8-84f8-4bcc-8bd2-cd97a7b57b2d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:53.874384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b37b8-84f8-4bcc-8bd2-cd97a7b57b2d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:53.879062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8eba0-b512-4020-9bd5-4a56d8657ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:53.879715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8eba0-b512-4020-9bd5-4a56d8657ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:53.879993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8eba0-b512-4020-9bd5-4a56d8657ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:53.880808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8eba0-b512-4020-9bd5-4a56d8657ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:53.881521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8eba0-b512-4020-9bd5-4a56d8657ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:53.883420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8eba0-b512-4020-9bd5-4a56d8657ed9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:53.912378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1187/2378] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:43:53 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:43:53.913510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262dd27-73b4-4f4a-b70c-c5dbd4db15be admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:53.924070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262dd27-73b4-4f4a-b70c-c5dbd4db15be admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:53.980761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9abf7b-3497-4579-b7d3-4e00da2598a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:53.981507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9abf7b-3497-4579-b7d3-4e00da2598a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:53.981789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9abf7b-3497-4579-b7d3-4e00da2598a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:53.982064 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9abf7b-3497-4579-b7d3-4e00da2598a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:53.982840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9abf7b-3497-4579-b7d3-4e00da2598a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:53.984824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9abf7b-3497-4579-b7d3-4e00da2598a1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:54.008901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1192/2379] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:43:53 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:43:54.010650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8eba0-b512-4020-9bd5-4a56d8657ed9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:54.021118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8eba0-b512-4020-9bd5-4a56d8657ed9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:54.026195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb1cff-dc54-4afa-96ac-4e4bb07f7078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:54.026914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1cff-dc54-4afa-96ac-4e4bb07f7078 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:54.027195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1cff-dc54-4afa-96ac-4e4bb07f7078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:54.027471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1cff-dc54-4afa-96ac-4e4bb07f7078 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:54.028207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb1cff-dc54-4afa-96ac-4e4bb07f7078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:54.029831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb1cff-dc54-4afa-96ac-4e4bb07f7078 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:54.040362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1188/2380] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:54.044313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9abf7b-3497-4579-b7d3-4e00da2598a1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:54.054529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9abf7b-3497-4579-b7d3-4e00da2598a1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:54.059091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca110f28-c456-48d8-8e5c-5967cd4369f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:54.059730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110f28-c456-48d8-8e5c-5967cd4369f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:54.060005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110f28-c456-48d8-8e5c-5967cd4369f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:54.060275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110f28-c456-48d8-8e5c-5967cd4369f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:54.061037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca110f28-c456-48d8-8e5c-5967cd4369f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:54.062607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca110f28-c456-48d8-8e5c-5967cd4369f2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:54.073037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1193/2381] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:43:54.076865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb1cff-dc54-4afa-96ac-4e4bb07f7078 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:54.086556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb1cff-dc54-4afa-96ac-4e4bb07f7078 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:54.091097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2989009-6e1f-4d40-bc43-99023c461061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:54.091950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2989009-6e1f-4d40-bc43-99023c461061 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:54.092223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2989009-6e1f-4d40-bc43-99023c461061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:54.092526 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2989009-6e1f-4d40-bc43-99023c461061 admin admin] PATH_INFO: `/v3/projects/faf261700d044e489491c3ce8ebe21d4/users/51c73094ad8e4b3da5134b00df289bf6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:54.106353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2989009-6e1f-4d40-bc43-99023c461061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf261700d044e489491c3ce8ebe21d4, user_id=51c73094ad8e4b3da5134b00df289bf6, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:54.109004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2989009-6e1f-4d40-bc43-99023c461061 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:54.121977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1189/2382] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:43:54 2022] PUT /identity/v3/projects/faf261700d044e489491c3ce8ebe21d4/users/51c73094ad8e4b3da5134b00df289bf6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:43:54.133253 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87c3f0-a264-452c-9ba4-78bb0018e25e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:54.133541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87c3f0-a264-452c-9ba4-78bb0018e25e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:54.133816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87c3f0-a264-452c-9ba4-78bb0018e25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:54.159898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8b87c3f0-a264-452c-9ba4-78bb0018e25e None None] MFA Rules not processed for user `51c73094ad8e4b3da5134b00df289bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:54.161117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8b87c3f0-a264-452c-9ba4-78bb0018e25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:54.222215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1194/2383] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:54.233342 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2989009-6e1f-4d40-bc43-99023c461061 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:54.235074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c2989009-6e1f-4d40-bc43-99023c461061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:54.332006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2989009-6e1f-4d40-bc43-99023c461061 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:54.337724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c1ce-65f2-4d9f-b122-fddd6dccee5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:54.338353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c1ce-65f2-4d9f-b122-fddd6dccee5b service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:54.338634 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c1ce-65f2-4d9f-b122-fddd6dccee5b service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:54.338908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c1ce-65f2-4d9f-b122-fddd6dccee5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:54.346484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c1ce-65f2-4d9f-b122-fddd6dccee5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:54.348051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c1ce-65f2-4d9f-b122-fddd6dccee5b service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:54.357224 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1190/2384] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:54.529186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87c3f0-a264-452c-9ba4-78bb0018e25e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:54.588218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87c3f0-a264-452c-9ba4-78bb0018e25e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:54.592623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:54.593471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:54.593744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:54.594012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] PATH_INFO: `/v3/users/51c73094ad8e4b3da5134b00df289bf6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:54.595191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c73094ad8e4b3da5134b00df289bf6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:54.597119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:54.642781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c73094ad8e4b3da5134b00df289bf6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:54.649671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c73094ad8e4b3da5134b00df289bf6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:54.656468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c73094ad8e4b3da5134b00df289bf6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:54.667856 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c73094ad8e4b3da5134b00df289bf6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:54.668525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c73094ad8e4b3da5134b00df289bf6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:54.674299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1195/2385] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:43:54 2022] DELETE /identity/v3/users/51c73094ad8e4b3da5134b00df289bf6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:54.679869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3f1b2-f059-4e6c-969b-2abd4ae7e1a2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:54.679869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3f1b2-f059-4e6c-969b-2abd4ae7e1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:54.680336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3f1b2-f059-4e6c-969b-2abd4ae7e1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:54.697209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-87d3f1b2-f059-4e6c-969b-2abd4ae7e1a2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:54.698636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-87d3f1b2-f059-4e6c-969b-2abd4ae7e1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:54.754428 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1191/2386] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:54.763833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:54.765238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:54.819573 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d782040-9a06-4e10-a8a9-2d3a3fc7822c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:54.823635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1077b3-4350-4926-8935-810b2cb2a9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:54.824324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1077b3-4350-4926-8935-810b2cb2a9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:54.824632 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1077b3-4350-4926-8935-810b2cb2a9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:54.824907 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1077b3-4350-4926-8935-810b2cb2a9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:54.835021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1077b3-4350-4926-8935-810b2cb2a9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:54.836542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1077b3-4350-4926-8935-810b2cb2a9f6 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:54.845880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1196/2387] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:55.180836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3f1b2-f059-4e6c-969b-2abd4ae7e1a2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.182239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-87d3f1b2-f059-4e6c-969b-2abd4ae7e1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:55.199951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3f1b2-f059-4e6c-969b-2abd4ae7e1a2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.204655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.205467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.205776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.205969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] PATH_INFO: `/v3/projects/faf261700d044e489491c3ce8ebe21d4` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.207268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf261700d044e489491c3ce8ebe21d4)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.209920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:55.255489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf261700d044e489491c3ce8ebe21d4', 'request_id': 'req-151a3da6-0def-4fd6-9412-30a54617118d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:55.261444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf261700d044e489491c3ce8ebe21d4', 'request_id': 'req-151a3da6-0def-4fd6-9412-30a54617118d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:55.266605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf261700d044e489491c3ce8ebe21d4', 'request_id': 'req-151a3da6-0def-4fd6-9412-30a54617118d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:55.278308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] The token cache is being invalidate because project faf261700d044e489491c3ce8ebe21d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:43:55.278586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:55.279186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-151a3da6-0def-4fd6-9412-30a54617118d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:55.280721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1192/2388] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:43:55 2022] DELETE /identity/v3/projects/faf261700d044e489491c3ce8ebe21d4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:55.286315 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f70d-8916-43f6-b4ec-db9e9aca6260 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.286624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f70d-8916-43f6-b4ec-db9e9aca6260 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.286898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4f70d-8916-43f6-b4ec-db9e9aca6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.304550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-24e4f70d-8916-43f6-b4ec-db9e9aca6260 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:55.305852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-24e4f70d-8916-43f6-b4ec-db9e9aca6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:55.362320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1197/2389] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:55.371044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aa87b-a053-4554-8c99-8693e4c5bf99 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.371333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aa87b-a053-4554-8c99-8693e4c5bf99 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.371609 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605aa87b-a053-4554-8c99-8693e4c5bf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.390765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-605aa87b-a053-4554-8c99-8693e4c5bf99 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:55.391948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-605aa87b-a053-4554-8c99-8693e4c5bf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:55.400521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1193/2390] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:55.404464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f70d-8916-43f6-b4ec-db9e9aca6260 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.413914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4f70d-8916-43f6-b4ec-db9e9aca6260 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.418356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb981-d0fb-4fb3-9ecf-a3ea305a0657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.418986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb981-d0fb-4fb3-9ecf-a3ea305a0657 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.419259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb981-d0fb-4fb3-9ecf-a3ea305a0657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.419529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb981-d0fb-4fb3-9ecf-a3ea305a0657 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.420258 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eb981-d0fb-4fb3-9ecf-a3ea305a0657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:43:55.420579 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eb981-d0fb-4fb3-9ecf-a3ea305a0657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.422143 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eb981-d0fb-4fb3-9ecf-a3ea305a0657 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:55.433893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1198/2391] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:43:55.437920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605aa87b-a053-4554-8c99-8693e4c5bf99 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.447752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605aa87b-a053-4554-8c99-8693e4c5bf99 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.452372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6affc-759d-429a-be7d-9766b775a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.453013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6affc-759d-429a-be7d-9766b775a76f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.453292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6affc-759d-429a-be7d-9766b775a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.453564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6affc-759d-429a-be7d-9766b775a76f admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.454266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6affc-759d-429a-be7d-9766b775a76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.456137 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c6affc-759d-429a-be7d-9766b775a76f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:55.480090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1194/2392] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:43:55 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:43:55.484104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb981-d0fb-4fb3-9ecf-a3ea305a0657 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.494266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb981-d0fb-4fb3-9ecf-a3ea305a0657 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.546915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408a66e-b730-462b-be23-d68d689f68ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.547560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408a66e-b730-462b-be23-d68d689f68ca admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.547836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408a66e-b730-462b-be23-d68d689f68ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.548108 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408a66e-b730-462b-be23-d68d689f68ca admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.548836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408a66e-b730-462b-be23-d68d689f68ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.550728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408a66e-b730-462b-be23-d68d689f68ca admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:55.570179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1199/2393] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:43:55 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:43:55.574247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6affc-759d-429a-be7d-9766b775a76f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.584215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6affc-759d-429a-be7d-9766b775a76f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.588804 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb812a9-ea6c-4b4c-a251-05d549517347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.589452 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb812a9-ea6c-4b4c-a251-05d549517347 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.589732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb812a9-ea6c-4b4c-a251-05d549517347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.590007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb812a9-ea6c-4b4c-a251-05d549517347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.590742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb812a9-ea6c-4b4c-a251-05d549517347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.592316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb812a9-ea6c-4b4c-a251-05d549517347 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:55.602563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1195/2394] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:55.606111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408a66e-b730-462b-be23-d68d689f68ca admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.616209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408a66e-b730-462b-be23-d68d689f68ca admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.620674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7024f03-6c68-48d2-87e8-e4cf619029fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.621302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024f03-6c68-48d2-87e8-e4cf619029fd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.621576 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024f03-6c68-48d2-87e8-e4cf619029fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.621845 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024f03-6c68-48d2-87e8-e4cf619029fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.622587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7024f03-6c68-48d2-87e8-e4cf619029fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.624154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7024f03-6c68-48d2-87e8-e4cf619029fd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:55.634405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1200/2395] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:55.638495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb812a9-ea6c-4b4c-a251-05d549517347 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.648175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb812a9-ea6c-4b4c-a251-05d549517347 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.652825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcf9f7-33a2-4b05-8403-5fa758e96668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.653683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcf9f7-33a2-4b05-8403-5fa758e96668 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.653961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcf9f7-33a2-4b05-8403-5fa758e96668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.654234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcf9f7-33a2-4b05-8403-5fa758e96668 admin admin] PATH_INFO: `/v3/projects/1bf0fe1c9f944bb59f8517ae0079b2cc/users/42dafaed28af4d71b33a0eee79a8a6ed/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.668110 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcf9f7-33a2-4b05-8403-5fa758e96668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf0fe1c9f944bb59f8517ae0079b2cc, user_id=42dafaed28af4d71b33a0eee79a8a6ed, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.670757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcf9f7-33a2-4b05-8403-5fa758e96668 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:55.684254 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1196/2396] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:43:55 2022] PUT /identity/v3/projects/1bf0fe1c9f944bb59f8517ae0079b2cc/users/42dafaed28af4d71b33a0eee79a8a6ed/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:43:55.694970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429bc9a-945b-482a-a4c7-410659e0bafb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.695256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429bc9a-945b-482a-a4c7-410659e0bafb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.695530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429bc9a-945b-482a-a4c7-410659e0bafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.721064 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8429bc9a-945b-482a-a4c7-410659e0bafb None None] MFA Rules not processed for user `42dafaed28af4d71b33a0eee79a8a6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:55.722262 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8429bc9a-945b-482a-a4c7-410659e0bafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:55.782687 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1201/2397] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:55.787122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcf9f7-33a2-4b05-8403-5fa758e96668 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.845173 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcf9f7-33a2-4b05-8403-5fa758e96668 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.850354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e6bc8-40ac-4bb2-b02c-d65b8b59453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.850990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e6bc8-40ac-4bb2-b02c-d65b8b59453b admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.851268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e6bc8-40ac-4bb2-b02c-d65b8b59453b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.851540 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e6bc8-40ac-4bb2-b02c-d65b8b59453b admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.852238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e6bc8-40ac-4bb2-b02c-d65b8b59453b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.854152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e6bc8-40ac-4bb2-b02c-d65b8b59453b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:55.878265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1197/2398] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:43:55 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:43:55.882234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429bc9a-945b-482a-a4c7-410659e0bafb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.892418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429bc9a-945b-482a-a4c7-410659e0bafb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.945764 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29310924-5068-4958-a3ea-f98ab5f035fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.946424 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29310924-5068-4958-a3ea-f98ab5f035fc admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.946705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29310924-5068-4958-a3ea-f98ab5f035fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.946982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29310924-5068-4958-a3ea-f98ab5f035fc admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.947957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29310924-5068-4958-a3ea-f98ab5f035fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.950843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29310924-5068-4958-a3ea-f98ab5f035fc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:55.972778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1202/2399] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:43:55 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:43:55.977316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e6bc8-40ac-4bb2-b02c-d65b8b59453b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:55.987485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e6bc8-40ac-4bb2-b02c-d65b8b59453b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:55.992739 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ce3ee-63c4-481d-937d-99e2949c597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:55.993380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ce3ee-63c4-481d-937d-99e2949c597a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:55.993657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ce3ee-63c4-481d-937d-99e2949c597a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:55.993929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ce3ee-63c4-481d-937d-99e2949c597a admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:55.994662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ce3ee-63c4-481d-937d-99e2949c597a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:55.996237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ce3ee-63c4-481d-937d-99e2949c597a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:56.006603 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1198/2400] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:56.010613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29310924-5068-4958-a3ea-f98ab5f035fc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:56.020326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29310924-5068-4958-a3ea-f98ab5f035fc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:56.025310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ea569-a72f-47d1-be64-4a5df0142849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:56.026173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ea569-a72f-47d1-be64-4a5df0142849 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:56.026453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ea569-a72f-47d1-be64-4a5df0142849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:56.026725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ea569-a72f-47d1-be64-4a5df0142849 admin admin] PATH_INFO: `/v3/projects/63061490802840eb851f9a149ae23619/users/1edf91b98b064c3ea730841d0979e3fb/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:56.041363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ea569-a72f-47d1-be64-4a5df0142849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63061490802840eb851f9a149ae23619, user_id=1edf91b98b064c3ea730841d0979e3fb, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:56.043998 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ea569-a72f-47d1-be64-4a5df0142849 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:56.056951 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1203/2401] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:43:56 2022] PUT /identity/v3/projects/63061490802840eb851f9a149ae23619/users/1edf91b98b064c3ea730841d0979e3fb/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:43:56.061387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ce3ee-63c4-481d-937d-99e2949c597a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:56.071116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ce3ee-63c4-481d-937d-99e2949c597a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:56.125994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afafd5-6a51-4caf-bdf9-29a2a47adfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:56.126655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afafd5-6a51-4caf-bdf9-29a2a47adfca admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:56.126939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afafd5-6a51-4caf-bdf9-29a2a47adfca admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:56.127214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afafd5-6a51-4caf-bdf9-29a2a47adfca admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:56.127943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afafd5-6a51-4caf-bdf9-29a2a47adfca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:56.129616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afafd5-6a51-4caf-bdf9-29a2a47adfca admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:56.139213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1199/2402] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:56.143746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ea569-a72f-47d1-be64-4a5df0142849 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:56.154792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ea569-a72f-47d1-be64-4a5df0142849 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:56.159381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ef94-b5aa-423c-9dfd-53260cc14134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:56.160243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ef94-b5aa-423c-9dfd-53260cc14134 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:56.160542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ef94-b5aa-423c-9dfd-53260cc14134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:56.160812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ef94-b5aa-423c-9dfd-53260cc14134 admin admin] PATH_INFO: `/v3/projects/63061490802840eb851f9a149ae23619/users/1edf91b98b064c3ea730841d0979e3fb/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:56.163307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ef94-b5aa-423c-9dfd-53260cc14134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63061490802840eb851f9a149ae23619, user_id=1edf91b98b064c3ea730841d0979e3fb, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:56.165955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ef94-b5aa-423c-9dfd-53260cc14134 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:56.175984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1204/2403] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:43:56 2022] PUT /identity/v3/projects/63061490802840eb851f9a149ae23619/users/1edf91b98b064c3ea730841d0979e3fb/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:56.186598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0dda9-8d65-447d-918c-b21a7c69945b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:56.186960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0dda9-8d65-447d-918c-b21a7c69945b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:56.187244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0dda9-8d65-447d-918c-b21a7c69945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:56.214105 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-04a0dda9-8d65-447d-918c-b21a7c69945b None None] MFA Rules not processed for user `1edf91b98b064c3ea730841d0979e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:56.215421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-04a0dda9-8d65-447d-918c-b21a7c69945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:56.282770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1200/2404] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:43:56.293281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ef94-b5aa-423c-9dfd-53260cc14134 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:56.294991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-4f00ef94-b5aa-423c-9dfd-53260cc14134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:56.351569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ef94-b5aa-423c-9dfd-53260cc14134 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:56.355188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6222d2-6c53-41ff-9428-d946bcd1186b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:56.355823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6222d2-6c53-41ff-9428-d946bcd1186b service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:56.356100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6222d2-6c53-41ff-9428-d946bcd1186b service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:56.356402 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6222d2-6c53-41ff-9428-d946bcd1186b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:56.365604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6222d2-6c53-41ff-9428-d946bcd1186b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:56.367021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6222d2-6c53-41ff-9428-d946bcd1186b service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:56.376079 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1205/2405] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:56.709632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0dda9-8d65-447d-918c-b21a7c69945b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:56.769020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0dda9-8d65-447d-918c-b21a7c69945b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:56.774106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:56.774954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:56.775229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:56.775495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] PATH_INFO: `/v3/users/42dafaed28af4d71b33a0eee79a8a6ed` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:56.776702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42dafaed28af4d71b33a0eee79a8a6ed)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:56.778594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:56.822896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42dafaed28af4d71b33a0eee79a8a6ed'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:56.829697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42dafaed28af4d71b33a0eee79a8a6ed'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:56.841665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42dafaed28af4d71b33a0eee79a8a6ed'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:56.842318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42dafaed28af4d71b33a0eee79a8a6ed'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:56.849148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42dafaed28af4d71b33a0eee79a8a6ed'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:56.855065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1201/2406] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:43:56 2022] DELETE /identity/v3/users/42dafaed28af4d71b33a0eee79a8a6ed => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:56.859666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d0ba3-0d31-45d6-877c-07912ff82575 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:56.860131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d0ba3-0d31-45d6-877c-07912ff82575 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:56.860288 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d0ba3-0d31-45d6-877c-07912ff82575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:56.877534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e12d0ba3-0d31-45d6-877c-07912ff82575 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:56.878718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e12d0ba3-0d31-45d6-877c-07912ff82575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:56.935580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1206/2407] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:56.945861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:56.947639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:57.007801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57866e8-44df-4ae2-afb8-754abdcf906f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:57.011728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b241a1d-1114-443a-921d-19b10de6a467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:57.012383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b241a1d-1114-443a-921d-19b10de6a467 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:57.012664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b241a1d-1114-443a-921d-19b10de6a467 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:57.012934 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b241a1d-1114-443a-921d-19b10de6a467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:57.021750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b241a1d-1114-443a-921d-19b10de6a467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:57.023219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b241a1d-1114-443a-921d-19b10de6a467 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:57.033442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1202/2408] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:57.303754 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d0ba3-0d31-45d6-877c-07912ff82575 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:57.305246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e12d0ba3-0d31-45d6-877c-07912ff82575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:57.318002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d0ba3-0d31-45d6-877c-07912ff82575 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:57.323203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:57.324058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:57.324328 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:57.325034 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] PATH_INFO: `/v3/projects/1bf0fe1c9f944bb59f8517ae0079b2cc` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:57.325909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf0fe1c9f944bb59f8517ae0079b2cc)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:57.327815 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:57.382390 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf0fe1c9f944bb59f8517ae0079b2cc', 'request_id': 'req-1207922c-3423-4c76-afd7-e22f7cd998e4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.389931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf0fe1c9f944bb59f8517ae0079b2cc', 'request_id': 'req-1207922c-3423-4c76-afd7-e22f7cd998e4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.397833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf0fe1c9f944bb59f8517ae0079b2cc', 'request_id': 'req-1207922c-3423-4c76-afd7-e22f7cd998e4'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.410135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] The token cache is being invalidate because project 1bf0fe1c9f944bb59f8517ae0079b2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:43:57.410478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.411179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.413486 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1207/2409] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:43:57 2022] DELETE /identity/v3/projects/1bf0fe1c9f944bb59f8517ae0079b2cc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:57.417399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b241a1d-1114-443a-921d-19b10de6a467 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:57.430595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b241a1d-1114-443a-921d-19b10de6a467 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:57.517959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:57.518840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:57.519123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:57.519399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] PATH_INFO: `/v3/users/1edf91b98b064c3ea730841d0979e3fb` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:57.521313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edf91b98b064c3ea730841d0979e3fb)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:57.523359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:57.575547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edf91b98b064c3ea730841d0979e3fb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.582806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edf91b98b064c3ea730841d0979e3fb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.596018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edf91b98b064c3ea730841d0979e3fb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.597471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edf91b98b064c3ea730841d0979e3fb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.605555 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d2f8870e-f420-4fea-a504-211f9be9304b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edf91b98b064c3ea730841d0979e3fb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.611926 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1203/2410] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:43:57 2022] DELETE /identity/v3/users/1edf91b98b064c3ea730841d0979e3fb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:57.866115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:57.867648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:57.881197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207922c-3423-4c76-afd7-e22f7cd998e4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:57.939205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:57.940098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:57.940402 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:57.940679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] PATH_INFO: `/v3/projects/63061490802840eb851f9a149ae23619` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:57.942021 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63061490802840eb851f9a149ae23619)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:57.944057 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:57.990910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63061490802840eb851f9a149ae23619', 'request_id': 'req-23d4618a-b060-476d-bfa8-e25bdf5bba2f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:57.998138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63061490802840eb851f9a149ae23619', 'request_id': 'req-23d4618a-b060-476d-bfa8-e25bdf5bba2f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:58.006215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63061490802840eb851f9a149ae23619', 'request_id': 'req-23d4618a-b060-476d-bfa8-e25bdf5bba2f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:58.017235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] The token cache is being invalidate because project 63061490802840eb851f9a149ae23619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:43:58.017523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:58.018156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-23d4618a-b060-476d-bfa8-e25bdf5bba2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:43:58.019696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1208/2411] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:43:57 2022] DELETE /identity/v3/projects/63061490802840eb851f9a149ae23619 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:58.027405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c3c8d-d4ad-4491-8ad5-ce296b345f1a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.027886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c3c8d-d4ad-4491-8ad5-ce296b345f1a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.027994 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c3c8d-d4ad-4491-8ad5-ce296b345f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.046376 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7e7c3c8d-d4ad-4491-8ad5-ce296b345f1a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:58.047590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7e7c3c8d-d4ad-4491-8ad5-ce296b345f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:58.104283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1204/2412] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:58.111747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3369a-9410-43a7-87de-472d0ce82744 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.112027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3369a-9410-43a7-87de-472d0ce82744 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.112300 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3369a-9410-43a7-87de-472d0ce82744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.129914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7ba3369a-9410-43a7-87de-472d0ce82744 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:58.131707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7ba3369a-9410-43a7-87de-472d0ce82744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:58.139433 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1209/2413] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:58.143522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c3c8d-d4ad-4491-8ad5-ce296b345f1a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.153606 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c3c8d-d4ad-4491-8ad5-ce296b345f1a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.158170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f281c-9085-4eed-a0b6-298731df1c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.158809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f281c-9085-4eed-a0b6-298731df1c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.159087 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f281c-9085-4eed-a0b6-298731df1c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.159359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f281c-9085-4eed-a0b6-298731df1c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.160084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f281c-9085-4eed-a0b6-298731df1c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:43:58.160427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f281c-9085-4eed-a0b6-298731df1c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.162021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f281c-9085-4eed-a0b6-298731df1c61 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.173035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1205/2414] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:43:58.176994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3369a-9410-43a7-87de-472d0ce82744 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.187675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3369a-9410-43a7-87de-472d0ce82744 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.192281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892551dd-baca-4a32-8c43-0b5caa366a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.193467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892551dd-baca-4a32-8c43-0b5caa366a00 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.193743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892551dd-baca-4a32-8c43-0b5caa366a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.194015 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892551dd-baca-4a32-8c43-0b5caa366a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.194699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892551dd-baca-4a32-8c43-0b5caa366a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.196606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892551dd-baca-4a32-8c43-0b5caa366a00 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.222318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1210/2415] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:43:58 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:43:58.226351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f281c-9085-4eed-a0b6-298731df1c61 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.236361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f281c-9085-4eed-a0b6-298731df1c61 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.290056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83f57f-6e79-46d8-b03a-647c9bff217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.290645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83f57f-6e79-46d8-b03a-647c9bff217f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.290924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83f57f-6e79-46d8-b03a-647c9bff217f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.291196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83f57f-6e79-46d8-b03a-647c9bff217f admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.291890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83f57f-6e79-46d8-b03a-647c9bff217f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.293805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83f57f-6e79-46d8-b03a-647c9bff217f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.312836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1206/2416] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:43:58 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:43:58.316852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892551dd-baca-4a32-8c43-0b5caa366a00 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.327631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892551dd-baca-4a32-8c43-0b5caa366a00 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.332241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f9479-9c56-4920-ad40-c1a69bd178f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.332919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f9479-9c56-4920-ad40-c1a69bd178f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.333200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f9479-9c56-4920-ad40-c1a69bd178f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.333474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f9479-9c56-4920-ad40-c1a69bd178f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.334822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f9479-9c56-4920-ad40-c1a69bd178f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.336439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f9479-9c56-4920-ad40-c1a69bd178f0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.346593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1211/2417] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:58.351071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83f57f-6e79-46d8-b03a-647c9bff217f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.360921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83f57f-6e79-46d8-b03a-647c9bff217f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.366441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece87e6-7617-4b9d-aa10-67989ec5bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.367159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece87e6-7617-4b9d-aa10-67989ec5bd1d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.367436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece87e6-7617-4b9d-aa10-67989ec5bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.367704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece87e6-7617-4b9d-aa10-67989ec5bd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.368478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece87e6-7617-4b9d-aa10-67989ec5bd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.370079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece87e6-7617-4b9d-aa10-67989ec5bd1d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.381684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1207/2418] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:58.385851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f9479-9c56-4920-ad40-c1a69bd178f0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.395609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f9479-9c56-4920-ad40-c1a69bd178f0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.400240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aa72e-0189-4c81-96ee-30112700c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.401176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aa72e-0189-4c81-96ee-30112700c09c admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.401453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aa72e-0189-4c81-96ee-30112700c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.401724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2aa72e-0189-4c81-96ee-30112700c09c admin admin] PATH_INFO: `/v3/projects/9b6f9907e1ef424abc47fa37c1d1edeb/users/ff079d3aecb646838e5b027ef00eea0e/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.416287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aa72e-0189-4c81-96ee-30112700c09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6f9907e1ef424abc47fa37c1d1edeb, user_id=ff079d3aecb646838e5b027ef00eea0e, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.418980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2aa72e-0189-4c81-96ee-30112700c09c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.432183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1212/2419] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:43:58 2022] PUT /identity/v3/projects/9b6f9907e1ef424abc47fa37c1d1edeb/users/ff079d3aecb646838e5b027ef00eea0e/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:58.442645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef94d0-346a-4f38-8501-9f3b24cc6299 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.442957 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef94d0-346a-4f38-8501-9f3b24cc6299 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.443315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef94d0-346a-4f38-8501-9f3b24cc6299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.469252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f1ef94d0-346a-4f38-8501-9f3b24cc6299 None None] MFA Rules not processed for user `ff079d3aecb646838e5b027ef00eea0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:58.470443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f1ef94d0-346a-4f38-8501-9f3b24cc6299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:58.535882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1208/2420] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:43:58.541157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aa72e-0189-4c81-96ee-30112700c09c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.601638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2aa72e-0189-4c81-96ee-30112700c09c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.606243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086322-1c4c-457f-9e6c-dcfa6b4840f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.606893 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086322-1c4c-457f-9e6c-dcfa6b4840f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.607213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086322-1c4c-457f-9e6c-dcfa6b4840f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.607437 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b086322-1c4c-457f-9e6c-dcfa6b4840f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.608139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b086322-1c4c-457f-9e6c-dcfa6b4840f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.610074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b086322-1c4c-457f-9e6c-dcfa6b4840f5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.640255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1213/2421] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:43:58 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:43:58.641474 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef94d0-346a-4f38-8501-9f3b24cc6299 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.653138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef94d0-346a-4f38-8501-9f3b24cc6299 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.710038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ecad4-0b46-42a7-886b-906701f8a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.710707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ecad4-0b46-42a7-886b-906701f8a393 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.710991 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ecad4-0b46-42a7-886b-906701f8a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.711270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ecad4-0b46-42a7-886b-906701f8a393 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.711980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ecad4-0b46-42a7-886b-906701f8a393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.713929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ecad4-0b46-42a7-886b-906701f8a393 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.734494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1209/2422] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:43:58 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:43:58.738377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086322-1c4c-457f-9e6c-dcfa6b4840f5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.748520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b086322-1c4c-457f-9e6c-dcfa6b4840f5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.753116 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e11a44-4dfd-4763-811f-0d43079559c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.753760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11a44-4dfd-4763-811f-0d43079559c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.754041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11a44-4dfd-4763-811f-0d43079559c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.754315 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e11a44-4dfd-4763-811f-0d43079559c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.755038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e11a44-4dfd-4763-811f-0d43079559c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.756720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e11a44-4dfd-4763-811f-0d43079559c0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.766939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1214/2423] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:58.770673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ecad4-0b46-42a7-886b-906701f8a393 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.780740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ecad4-0b46-42a7-886b-906701f8a393 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.785266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c764d0a-1e5e-48fe-8d31-fbf6cf09088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.786141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c764d0a-1e5e-48fe-8d31-fbf6cf09088c admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.786414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c764d0a-1e5e-48fe-8d31-fbf6cf09088c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.787288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c764d0a-1e5e-48fe-8d31-fbf6cf09088c admin admin] PATH_INFO: `/v3/projects/700dc2b5f0d2416cb70d443830af9b65/users/19f911b13ffb48baaa73266dfe1a5582/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.801400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c764d0a-1e5e-48fe-8d31-fbf6cf09088c admin admin] RBAC: Authorizing `identity:create_grant(project_id=700dc2b5f0d2416cb70d443830af9b65, user_id=19f911b13ffb48baaa73266dfe1a5582, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.803944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c764d0a-1e5e-48fe-8d31-fbf6cf09088c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.816785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1210/2424] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:43:58 2022] PUT /identity/v3/projects/700dc2b5f0d2416cb70d443830af9b65/users/19f911b13ffb48baaa73266dfe1a5582/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:43:58.821002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e11a44-4dfd-4763-811f-0d43079559c0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.831003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e11a44-4dfd-4763-811f-0d43079559c0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.884950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c96924-37c5-442c-908d-240643ae75fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.885603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96924-37c5-442c-908d-240643ae75fa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.885884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96924-37c5-442c-908d-240643ae75fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.886158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c96924-37c5-442c-908d-240643ae75fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.886880 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c96924-37c5-442c-908d-240643ae75fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.888495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c96924-37c5-442c-908d-240643ae75fa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.898520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1215/2425] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:43:58.902489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c764d0a-1e5e-48fe-8d31-fbf6cf09088c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:58.912467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c764d0a-1e5e-48fe-8d31-fbf6cf09088c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:58.917036 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a0a91-4630-49e2-b187-b9b1bf6b09ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:58.917894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a0a91-4630-49e2-b187-b9b1bf6b09ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.918169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a0a91-4630-49e2-b187-b9b1bf6b09ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.918438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a0a91-4630-49e2-b187-b9b1bf6b09ff admin admin] PATH_INFO: `/v3/projects/700dc2b5f0d2416cb70d443830af9b65/users/19f911b13ffb48baaa73266dfe1a5582/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.920409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a0a91-4630-49e2-b187-b9b1bf6b09ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=700dc2b5f0d2416cb70d443830af9b65, user_id=19f911b13ffb48baaa73266dfe1a5582, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:58.922992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a0a91-4630-49e2-b187-b9b1bf6b09ff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:58.932984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1211/2426] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:43:58 2022] PUT /identity/v3/projects/700dc2b5f0d2416cb70d443830af9b65/users/19f911b13ffb48baaa73266dfe1a5582/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:43:58.944160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51cd0-61e3-404c-80a3-f8095b7dc445 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:58.944476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51cd0-61e3-404c-80a3-f8095b7dc445 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:58.944757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd51cd0-61e3-404c-80a3-f8095b7dc445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:58.971740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ddd51cd0-61e3-404c-80a3-f8095b7dc445 None None] MFA Rules not processed for user `19f911b13ffb48baaa73266dfe1a5582`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:43:58.972974 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ddd51cd0-61e3-404c-80a3-f8095b7dc445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:59.036822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1216/2427] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:43:58 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:43:59.046655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a0a91-4630-49e2-b187-b9b1bf6b09ff admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:59.048362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d86a0a91-4630-49e2-b187-b9b1bf6b09ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:43:59.103918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a0a91-4630-49e2-b187-b9b1bf6b09ff admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:59.107479 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d47e1-033c-4046-aee5-1b2061ae84a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:59.108112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d47e1-033c-4046-aee5-1b2061ae84a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:59.108426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d47e1-033c-4046-aee5-1b2061ae84a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:59.108706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d47e1-033c-4046-aee5-1b2061ae84a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:59.117513 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d47e1-033c-4046-aee5-1b2061ae84a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:59.118929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d47e1-033c-4046-aee5-1b2061ae84a6 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:59.128138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1212/2428] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:43:59.198659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd51cd0-61e3-404c-80a3-f8095b7dc445 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:43:59.208065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd51cd0-61e3-404c-80a3-f8095b7dc445 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:43:59.211700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35bcef-654e-4b37-9c32-f5dbfffbcded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:43:59.212326 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35bcef-654e-4b37-9c32-f5dbfffbcded service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:43:59.212631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35bcef-654e-4b37-9c32-f5dbfffbcded service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:43:59.212903 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35bcef-654e-4b37-9c32-f5dbfffbcded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:43:59.267848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35bcef-654e-4b37-9c32-f5dbfffbcded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:43:59.269299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35bcef-654e-4b37-9c32-f5dbfffbcded service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:43:59.279647 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1217/2429] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:43:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:11.433972 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d47e1-033c-4046-aee5-1b2061ae84a6 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:11.496227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d47e1-033c-4046-aee5-1b2061ae84a6 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:11.500872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:11.501723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:11.502004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:11.502279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] PATH_INFO: `/v3/users/ff079d3aecb646838e5b027ef00eea0e` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:11.503455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff079d3aecb646838e5b027ef00eea0e)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:11.505400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:11.548898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff079d3aecb646838e5b027ef00eea0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:11.555707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff079d3aecb646838e5b027ef00eea0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:11.566936 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff079d3aecb646838e5b027ef00eea0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:11.568208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff079d3aecb646838e5b027ef00eea0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:11.575131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff079d3aecb646838e5b027ef00eea0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:11.580987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1213/2430] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:44:11 2022] DELETE /identity/v3/users/ff079d3aecb646838e5b027ef00eea0e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:11.586057 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1352b0d-66f7-4de3-95d0-01572f8e5462 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:11.586595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1352b0d-66f7-4de3-95d0-01572f8e5462 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:11.586847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1352b0d-66f7-4de3-95d0-01572f8e5462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:11.605771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-d1352b0d-66f7-4de3-95d0-01572f8e5462 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:11.607059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d1352b0d-66f7-4de3-95d0-01572f8e5462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:11.664082 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1218/2431] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:11.673485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:11.675002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:11.736562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0a5f8-d7c2-4ebe-a793-d1207d0bfa0d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:11.740814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816243b-a318-4c96-b059-b3d9ee06b17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:11.741463 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816243b-a318-4c96-b059-b3d9ee06b17d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:11.741740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816243b-a318-4c96-b059-b3d9ee06b17d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:11.742017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816243b-a318-4c96-b059-b3d9ee06b17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:11.751239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816243b-a318-4c96-b059-b3d9ee06b17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:11.752746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816243b-a318-4c96-b059-b3d9ee06b17d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:11.762429 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1214/2432] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:12.013758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1352b0d-66f7-4de3-95d0-01572f8e5462 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:12.015460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-d1352b0d-66f7-4de3-95d0-01572f8e5462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:12.028671 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1352b0d-66f7-4de3-95d0-01572f8e5462 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:12.033237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:12.034145 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:12.034417 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:12.034686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] PATH_INFO: `/v3/projects/9b6f9907e1ef424abc47fa37c1d1edeb` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:12.035866 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6f9907e1ef424abc47fa37c1d1edeb)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:12.038430 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:12.084035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6f9907e1ef424abc47fa37c1d1edeb', 'request_id': 'req-bdf170cb-3da2-4b39-8088-c62a6d386a6c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.089994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6f9907e1ef424abc47fa37c1d1edeb', 'request_id': 'req-bdf170cb-3da2-4b39-8088-c62a6d386a6c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.096691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6f9907e1ef424abc47fa37c1d1edeb', 'request_id': 'req-bdf170cb-3da2-4b39-8088-c62a6d386a6c'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.107020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] The token cache is being invalidate because project 9b6f9907e1ef424abc47fa37c1d1edeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:44:12.107285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.107909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.109465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1219/2433] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:44:12 2022] DELETE /identity/v3/projects/9b6f9907e1ef424abc47fa37c1d1edeb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:12.113362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816243b-a318-4c96-b059-b3d9ee06b17d service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:12.122809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816243b-a318-4c96-b059-b3d9ee06b17d service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:12.176869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:12.177717 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:12.177990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:12.178259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] PATH_INFO: `/v3/users/19f911b13ffb48baaa73266dfe1a5582` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:12.179432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f911b13ffb48baaa73266dfe1a5582)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:12.181347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:12.223394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f911b13ffb48baaa73266dfe1a5582'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.230569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f911b13ffb48baaa73266dfe1a5582'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.241860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f911b13ffb48baaa73266dfe1a5582'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.242530 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f911b13ffb48baaa73266dfe1a5582'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.249836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-105c11bc-2b98-4e71-99d8-9da1f3b79ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f911b13ffb48baaa73266dfe1a5582'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.255844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1215/2434] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:44:12 2022] DELETE /identity/v3/users/19f911b13ffb48baaa73266dfe1a5582 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:12.526606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:12.528185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:12.541395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf170cb-3da2-4b39-8088-c62a6d386a6c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:12.598463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:12.599845 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:12.600118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:12.600414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] PATH_INFO: `/v3/projects/700dc2b5f0d2416cb70d443830af9b65` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:12.601645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700dc2b5f0d2416cb70d443830af9b65)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:12.603480 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:12.646471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700dc2b5f0d2416cb70d443830af9b65', 'request_id': 'req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.652801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700dc2b5f0d2416cb70d443830af9b65', 'request_id': 'req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.660180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700dc2b5f0d2416cb70d443830af9b65', 'request_id': 'req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.670819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] The token cache is being invalidate because project 700dc2b5f0d2416cb70d443830af9b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:44:12.671107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.671731 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-313bb9bf-aca5-4cba-9d9e-5a0a604378e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:12.673617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1220/2435] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:44:12 2022] DELETE /identity/v3/projects/700dc2b5f0d2416cb70d443830af9b65 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:12.679719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02c4c6-094a-4777-8d48-60f1f664bda9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:12.680088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02c4c6-094a-4777-8d48-60f1f664bda9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:12.680268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02c4c6-094a-4777-8d48-60f1f664bda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:12.698239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ea02c4c6-094a-4777-8d48-60f1f664bda9 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:12.699419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ea02c4c6-094a-4777-8d48-60f1f664bda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:12.754532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1216/2436] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:12.762847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83357a3-979e-4d0e-9f9b-7283e499ed47 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:12.763161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83357a3-979e-4d0e-9f9b-7283e499ed47 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:12.763439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83357a3-979e-4d0e-9f9b-7283e499ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:12.782217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a83357a3-979e-4d0e-9f9b-7283e499ed47 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:12.783406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a83357a3-979e-4d0e-9f9b-7283e499ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:12.791979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1221/2437] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:12.796101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02c4c6-094a-4777-8d48-60f1f664bda9 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:12.805890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02c4c6-094a-4777-8d48-60f1f664bda9 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:12.810460 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccd2f9-a5bf-4961-9f3e-dafb27c5dcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:12.811102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccd2f9-a5bf-4961-9f3e-dafb27c5dcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:12.811383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccd2f9-a5bf-4961-9f3e-dafb27c5dcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:12.811653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccd2f9-a5bf-4961-9f3e-dafb27c5dcc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:12.812406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccd2f9-a5bf-4961-9f3e-dafb27c5dcc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:44:12.812710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccd2f9-a5bf-4961-9f3e-dafb27c5dcc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:12.814317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccd2f9-a5bf-4961-9f3e-dafb27c5dcc1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:12.825633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1217/2438] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:44:12.829826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83357a3-979e-4d0e-9f9b-7283e499ed47 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:12.839243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83357a3-979e-4d0e-9f9b-7283e499ed47 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:12.844151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a820f6-6c15-4c65-8f78-b86c1a69313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:12.844877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a820f6-6c15-4c65-8f78-b86c1a69313b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:12.845140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a820f6-6c15-4c65-8f78-b86c1a69313b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:12.845414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a820f6-6c15-4c65-8f78-b86c1a69313b admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:12.846127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a820f6-6c15-4c65-8f78-b86c1a69313b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:12.848163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a820f6-6c15-4c65-8f78-b86c1a69313b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:12.875437 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1222/2439] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:44:12 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:44:12.879534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccd2f9-a5bf-4961-9f3e-dafb27c5dcc1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:12.889675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccd2f9-a5bf-4961-9f3e-dafb27c5dcc1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:12.944438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501bec2-1ca2-40e5-b38a-9d01fb80d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:12.945100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501bec2-1ca2-40e5-b38a-9d01fb80d85e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:12.945376 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501bec2-1ca2-40e5-b38a-9d01fb80d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:12.945647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501bec2-1ca2-40e5-b38a-9d01fb80d85e admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:12.946512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501bec2-1ca2-40e5-b38a-9d01fb80d85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:12.948699 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501bec2-1ca2-40e5-b38a-9d01fb80d85e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:12.971069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1218/2440] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:44:12 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:12.975722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a820f6-6c15-4c65-8f78-b86c1a69313b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:12.986150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a820f6-6c15-4c65-8f78-b86c1a69313b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:12.991036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8caad-fcc1-4a81-8c4f-2994bf910f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:12.991685 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8caad-fcc1-4a81-8c4f-2994bf910f4c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:12.991967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8caad-fcc1-4a81-8c4f-2994bf910f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:12.992240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8caad-fcc1-4a81-8c4f-2994bf910f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:12.993016 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8caad-fcc1-4a81-8c4f-2994bf910f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:12.994597 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8caad-fcc1-4a81-8c4f-2994bf910f4c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.005434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1223/2441] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:13.010824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501bec2-1ca2-40e5-b38a-9d01fb80d85e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.021243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501bec2-1ca2-40e5-b38a-9d01fb80d85e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.025858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd6ab3-0a5a-4df9-9264-267fbea2d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.026499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6ab3-0a5a-4df9-9264-267fbea2d6af admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.026781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6ab3-0a5a-4df9-9264-267fbea2d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.027060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6ab3-0a5a-4df9-9264-267fbea2d6af admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.027788 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd6ab3-0a5a-4df9-9264-267fbea2d6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.029399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd6ab3-0a5a-4df9-9264-267fbea2d6af admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.039640 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1219/2442] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:13.043679 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8caad-fcc1-4a81-8c4f-2994bf910f4c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.053497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8caad-fcc1-4a81-8c4f-2994bf910f4c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.058280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76cfe7-47fa-4520-8611-adb54df3a3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.059148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76cfe7-47fa-4520-8611-adb54df3a3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.059429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76cfe7-47fa-4520-8611-adb54df3a3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.059704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76cfe7-47fa-4520-8611-adb54df3a3d7 admin admin] PATH_INFO: `/v3/projects/df8a50ddd7e04eec83877794d5a284de/users/01c563c1925d4ffb8017e5e65cb964c2/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.074630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76cfe7-47fa-4520-8611-adb54df3a3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8a50ddd7e04eec83877794d5a284de, user_id=01c563c1925d4ffb8017e5e65cb964c2, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.077294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76cfe7-47fa-4520-8611-adb54df3a3d7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.089987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1224/2443] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:13 2022] PUT /identity/v3/projects/df8a50ddd7e04eec83877794d5a284de/users/01c563c1925d4ffb8017e5e65cb964c2/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:13.101141 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8c08-75d0-44ea-9e4b-63d9d64aa002 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.101427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8c08-75d0-44ea-9e4b-63d9d64aa002 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.101700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8c08-75d0-44ea-9e4b-63d9d64aa002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.127714 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-343c8c08-75d0-44ea-9e4b-63d9d64aa002 None None] MFA Rules not processed for user `01c563c1925d4ffb8017e5e65cb964c2`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:13.128907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-343c8c08-75d0-44ea-9e4b-63d9d64aa002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:13.191659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1220/2444] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:44:13.196203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76cfe7-47fa-4520-8611-adb54df3a3d7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.254414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76cfe7-47fa-4520-8611-adb54df3a3d7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.259046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55852c-de80-4e36-8904-1937dc13efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.259686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55852c-de80-4e36-8904-1937dc13efa0 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.259962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55852c-de80-4e36-8904-1937dc13efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.260235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55852c-de80-4e36-8904-1937dc13efa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.261419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55852c-de80-4e36-8904-1937dc13efa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.263312 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55852c-de80-4e36-8904-1937dc13efa0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.290363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1225/2445] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:44:13 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:13.293455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8c08-75d0-44ea-9e4b-63d9d64aa002 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.304756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8c08-75d0-44ea-9e4b-63d9d64aa002 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.362461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879dc1d-1ef8-4de3-945f-6bbc3312a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.363131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879dc1d-1ef8-4de3-945f-6bbc3312a12a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.363410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879dc1d-1ef8-4de3-945f-6bbc3312a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.363737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879dc1d-1ef8-4de3-945f-6bbc3312a12a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.365138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879dc1d-1ef8-4de3-945f-6bbc3312a12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.367048 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879dc1d-1ef8-4de3-945f-6bbc3312a12a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.388450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1221/2446] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:44:13 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:44:13.392289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55852c-de80-4e36-8904-1937dc13efa0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.402360 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55852c-de80-4e36-8904-1937dc13efa0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.407118 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3deb785-3783-427a-8302-601626b98e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.407829 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deb785-3783-427a-8302-601626b98e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.408176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deb785-3783-427a-8302-601626b98e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.408487 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deb785-3783-427a-8302-601626b98e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.409208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3deb785-3783-427a-8302-601626b98e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.410865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3deb785-3783-427a-8302-601626b98e59 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.425251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1226/2447] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:13.426375 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879dc1d-1ef8-4de3-945f-6bbc3312a12a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.436812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879dc1d-1ef8-4de3-945f-6bbc3312a12a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.441384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f9c6a-8c43-4333-b678-23824278ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.442248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f9c6a-8c43-4333-b678-23824278ddae admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.442562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f9c6a-8c43-4333-b678-23824278ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.442830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f9c6a-8c43-4333-b678-23824278ddae admin admin] PATH_INFO: `/v3/projects/3f89bf97f21c481abf422abfed860dde/users/67bcde8ce6af4737ad65fc3dd8bf2020/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.457912 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f9c6a-8c43-4333-b678-23824278ddae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f89bf97f21c481abf422abfed860dde, user_id=67bcde8ce6af4737ad65fc3dd8bf2020, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.461119 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f9c6a-8c43-4333-b678-23824278ddae admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.474383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1222/2448] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:13 2022] PUT /identity/v3/projects/3f89bf97f21c481abf422abfed860dde/users/67bcde8ce6af4737ad65fc3dd8bf2020/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:44:13.478400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3deb785-3783-427a-8302-601626b98e59 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.488924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3deb785-3783-427a-8302-601626b98e59 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.546911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47e259-8334-4012-bde4-1d087a042904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.547563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47e259-8334-4012-bde4-1d087a042904 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.547872 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47e259-8334-4012-bde4-1d087a042904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.548150 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47e259-8334-4012-bde4-1d087a042904 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.548919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47e259-8334-4012-bde4-1d087a042904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.550529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47e259-8334-4012-bde4-1d087a042904 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.560184 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1227/2449] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:13.564557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f9c6a-8c43-4333-b678-23824278ddae admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.575132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f9c6a-8c43-4333-b678-23824278ddae admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.580315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906e5f4-2186-4290-bd08-f87f32dbfee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.581242 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906e5f4-2186-4290-bd08-f87f32dbfee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.581513 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906e5f4-2186-4290-bd08-f87f32dbfee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.581842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906e5f4-2186-4290-bd08-f87f32dbfee5 admin admin] PATH_INFO: `/v3/projects/3f89bf97f21c481abf422abfed860dde/users/67bcde8ce6af4737ad65fc3dd8bf2020/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.584503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906e5f4-2186-4290-bd08-f87f32dbfee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f89bf97f21c481abf422abfed860dde, user_id=67bcde8ce6af4737ad65fc3dd8bf2020, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.587262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906e5f4-2186-4290-bd08-f87f32dbfee5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.598150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1223/2450] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:13 2022] PUT /identity/v3/projects/3f89bf97f21c481abf422abfed860dde/users/67bcde8ce6af4737ad65fc3dd8bf2020/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:13.610526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b6c8-23bc-4d60-acbc-fbe93e8a9706 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.611019 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b6c8-23bc-4d60-acbc-fbe93e8a9706 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.611207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b6c8-23bc-4d60-acbc-fbe93e8a9706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.638049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-9095b6c8-23bc-4d60-acbc-fbe93e8a9706 None None] MFA Rules not processed for user `67bcde8ce6af4737ad65fc3dd8bf2020`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:13.639346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9095b6c8-23bc-4d60-acbc-fbe93e8a9706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:13.709606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1228/2451] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:13.719069 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906e5f4-2186-4290-bd08-f87f32dbfee5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.720908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5906e5f4-2186-4290-bd08-f87f32dbfee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:13.795852 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906e5f4-2186-4290-bd08-f87f32dbfee5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.799504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da2e6a-a930-4e60-9bff-1ff1464a7a66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.800162 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da2e6a-a930-4e60-9bff-1ff1464a7a66 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.800496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da2e6a-a930-4e60-9bff-1ff1464a7a66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.800774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da2e6a-a930-4e60-9bff-1ff1464a7a66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.809636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da2e6a-a930-4e60-9bff-1ff1464a7a66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.811056 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da2e6a-a930-4e60-9bff-1ff1464a7a66 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.821101 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1224/2452] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:13.863538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b6c8-23bc-4d60-acbc-fbe93e8a9706 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:13.864995 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-9095b6c8-23bc-4d60-acbc-fbe93e8a9706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:13.876803 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b6c8-23bc-4d60-acbc-fbe93e8a9706 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:13.880946 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f3400-3127-4500-adcb-0b8d238972f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:13.881572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3400-3127-4500-adcb-0b8d238972f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:13.881847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3400-3127-4500-adcb-0b8d238972f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:13.882119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f3400-3127-4500-adcb-0b8d238972f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:13.935061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3400-3127-4500-adcb-0b8d238972f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:13.936444 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f3400-3127-4500-adcb-0b8d238972f9 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:13.946938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1229/2453] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:19.212777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da2e6a-a930-4e60-9bff-1ff1464a7a66 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:19.272400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da2e6a-a930-4e60-9bff-1ff1464a7a66 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:19.276954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:19.277813 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:19.278094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:19.278372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] PATH_INFO: `/v3/users/01c563c1925d4ffb8017e5e65cb964c2` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:19.279561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c563c1925d4ffb8017e5e65cb964c2)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:19.281492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:19.326483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c563c1925d4ffb8017e5e65cb964c2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.333005 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c563c1925d4ffb8017e5e65cb964c2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.344112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c563c1925d4ffb8017e5e65cb964c2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.344848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c563c1925d4ffb8017e5e65cb964c2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.352950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c563c1925d4ffb8017e5e65cb964c2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.358894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1225/2454] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:44:19 2022] DELETE /identity/v3/users/01c563c1925d4ffb8017e5e65cb964c2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:19.363406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5df0-3ffd-4d58-9c8d-f2c0911cba4c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:19.363892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5df0-3ffd-4d58-9c8d-f2c0911cba4c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:19.364008 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5df0-3ffd-4d58-9c8d-f2c0911cba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:19.381638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-092f5df0-3ffd-4d58-9c8d-f2c0911cba4c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:19.382801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-092f5df0-3ffd-4d58-9c8d-f2c0911cba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:19.439100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1230/2455] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:44:19.448922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:19.450300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:19.505020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332d327-d0c2-4850-8a59-bab9e2f8eb9b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:19.508677 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dba08-14bc-41a1-b94b-ad466c7e13d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:19.509320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dba08-14bc-41a1-b94b-ad466c7e13d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:19.509600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dba08-14bc-41a1-b94b-ad466c7e13d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:19.509872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7dba08-14bc-41a1-b94b-ad466c7e13d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:19.518992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dba08-14bc-41a1-b94b-ad466c7e13d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:19.520996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7dba08-14bc-41a1-b94b-ad466c7e13d7 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:19.530256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1226/2456] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:19.782738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5df0-3ffd-4d58-9c8d-f2c0911cba4c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:19.784159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-092f5df0-3ffd-4d58-9c8d-f2c0911cba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:19.796541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f5df0-3ffd-4d58-9c8d-f2c0911cba4c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:19.801149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:19.802000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:19.802274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:19.802544 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] PATH_INFO: `/v3/projects/df8a50ddd7e04eec83877794d5a284de` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:19.803799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8a50ddd7e04eec83877794d5a284de)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:19.805812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:19.851009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8a50ddd7e04eec83877794d5a284de', 'request_id': 'req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.857126 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8a50ddd7e04eec83877794d5a284de', 'request_id': 'req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.864392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8a50ddd7e04eec83877794d5a284de', 'request_id': 'req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.874133 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] The token cache is being invalidate because project df8a50ddd7e04eec83877794d5a284de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:44:19.874418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.875040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.876622 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1231/2457] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:44:19 2022] DELETE /identity/v3/projects/df8a50ddd7e04eec83877794d5a284de => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:19.881044 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dba08-14bc-41a1-b94b-ad466c7e13d7 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:19.890431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7dba08-14bc-41a1-b94b-ad466c7e13d7 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:19.943780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:19.944742 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:19.945020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:19.945293 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] PATH_INFO: `/v3/users/67bcde8ce6af4737ad65fc3dd8bf2020` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:19.946473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bcde8ce6af4737ad65fc3dd8bf2020)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:19.948939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:19.991017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bcde8ce6af4737ad65fc3dd8bf2020'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:19.997797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bcde8ce6af4737ad65fc3dd8bf2020'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:20.009801 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bcde8ce6af4737ad65fc3dd8bf2020'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:20.010489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bcde8ce6af4737ad65fc3dd8bf2020'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:20.018427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d9cd2e03-5157-4640-b895-24bb22584fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bcde8ce6af4737ad65fc3dd8bf2020'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:20.025312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1227/2458] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:44:19 2022] DELETE /identity/v3/users/67bcde8ce6af4737ad65fc3dd8bf2020 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:20.295601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:20.297130 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:20.312088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81bd95-3b0a-409c-aa4d-c23c24053e7b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:20.367819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:20.368705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.368984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.369256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] PATH_INFO: `/v3/projects/3f89bf97f21c481abf422abfed860dde` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.370440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f89bf97f21c481abf422abfed860dde)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:20.372492 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:20.415511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f89bf97f21c481abf422abfed860dde', 'request_id': 'req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:20.421293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f89bf97f21c481abf422abfed860dde', 'request_id': 'req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:20.428066 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f89bf97f21c481abf422abfed860dde', 'request_id': 'req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:20.437950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] The token cache is being invalidate because project 3f89bf97f21c481abf422abfed860dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:44:20.438230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:20.438838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4ba6ec7-0539-443a-8a5e-bb924c4bfe2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:20.440333 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1232/2459] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:44:20 2022] DELETE /identity/v3/projects/3f89bf97f21c481abf422abfed860dde => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:20.446003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb046e-dbb5-4d73-8247-8dec82d693d8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.446461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb046e-dbb5-4d73-8247-8dec82d693d8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.446557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb046e-dbb5-4d73-8247-8dec82d693d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.465204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-83eb046e-dbb5-4d73-8247-8dec82d693d8 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:20.466405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-83eb046e-dbb5-4d73-8247-8dec82d693d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:20.522759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1228/2460] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:20.530553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ceeaf-4cf1-4068-8f8e-738d91fee7fe None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.530844 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ceeaf-4cf1-4068-8f8e-738d91fee7fe None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.531157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ceeaf-4cf1-4068-8f8e-738d91fee7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.549638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ce3ceeaf-4cf1-4068-8f8e-738d91fee7fe None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:20.550761 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ce3ceeaf-4cf1-4068-8f8e-738d91fee7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:20.558913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1233/2461] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:20.562810 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb046e-dbb5-4d73-8247-8dec82d693d8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:20.576167 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb046e-dbb5-4d73-8247-8dec82d693d8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:20.581354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e054c07-88d2-43b8-b445-aee8aff869de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:20.582066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e054c07-88d2-43b8-b445-aee8aff869de admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.582353 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e054c07-88d2-43b8-b445-aee8aff869de admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.582629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e054c07-88d2-43b8-b445-aee8aff869de admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.583969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e054c07-88d2-43b8-b445-aee8aff869de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:44:20.584278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e054c07-88d2-43b8-b445-aee8aff869de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:20.585902 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e054c07-88d2-43b8-b445-aee8aff869de admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:20.597499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1229/2462] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:44:20.602278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ceeaf-4cf1-4068-8f8e-738d91fee7fe None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:20.611388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ceeaf-4cf1-4068-8f8e-738d91fee7fe None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:20.616768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66123b6-75f3-4b6f-9e36-1a6b4c32f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:20.617401 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66123b6-75f3-4b6f-9e36-1a6b4c32f271 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.617677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66123b6-75f3-4b6f-9e36-1a6b4c32f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.617945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66123b6-75f3-4b6f-9e36-1a6b4c32f271 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.618636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66123b6-75f3-4b6f-9e36-1a6b4c32f271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:20.620543 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66123b6-75f3-4b6f-9e36-1a6b4c32f271 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:20.645595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1234/2463] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:44:20 2022] POST /identity/v3/projects => generated 407 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:20.649698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e054c07-88d2-43b8-b445-aee8aff869de admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:20.659723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e054c07-88d2-43b8-b445-aee8aff869de admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:20.714924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5238a50-c63d-4e13-92a9-fd2c84c40e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:20.715587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5238a50-c63d-4e13-92a9-fd2c84c40e8a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.715871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5238a50-c63d-4e13-92a9-fd2c84c40e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.716148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5238a50-c63d-4e13-92a9-fd2c84c40e8a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.716887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5238a50-c63d-4e13-92a9-fd2c84c40e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:20.718797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5238a50-c63d-4e13-92a9-fd2c84c40e8a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:20.738043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1230/2464] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:44:20 2022] POST /identity/v3/users => generated 304 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:20.742748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66123b6-75f3-4b6f-9e36-1a6b4c32f271 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:20.752853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66123b6-75f3-4b6f-9e36-1a6b4c32f271 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:20.757428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42fc7d-d84d-4f8c-b510-33361c8972bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:20.758077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42fc7d-d84d-4f8c-b510-33361c8972bf admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.758355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42fc7d-d84d-4f8c-b510-33361c8972bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.758627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42fc7d-d84d-4f8c-b510-33361c8972bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.759350 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42fc7d-d84d-4f8c-b510-33361c8972bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:20.760984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42fc7d-d84d-4f8c-b510-33361c8972bf admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:20.771171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1235/2465] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:20.774931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5238a50-c63d-4e13-92a9-fd2c84c40e8a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:20.784773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5238a50-c63d-4e13-92a9-fd2c84c40e8a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:20.789898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b5fef-2663-4d27-b1f1-0dac0c5b02b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:20.790538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b5fef-2663-4d27-b1f1-0dac0c5b02b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.790821 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b5fef-2663-4d27-b1f1-0dac0c5b02b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.791099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b5fef-2663-4d27-b1f1-0dac0c5b02b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.791860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b5fef-2663-4d27-b1f1-0dac0c5b02b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:20.793473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b5fef-2663-4d27-b1f1-0dac0c5b02b0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:20.803654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1231/2466] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:20.807284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42fc7d-d84d-4f8c-b510-33361c8972bf admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:20.816890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42fc7d-d84d-4f8c-b510-33361c8972bf admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:20.821455 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e812-ee05-424c-90b3-55a8afd0e59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:20.822574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e812-ee05-424c-90b3-55a8afd0e59a admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.822849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e812-ee05-424c-90b3-55a8afd0e59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.823119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e812-ee05-424c-90b3-55a8afd0e59a admin admin] PATH_INFO: `/v3/projects/79ed72c334c747c6bea0765fcc995083/users/f37353a79e414801aec34508311769ef/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.838108 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5e812-ee05-424c-90b3-55a8afd0e59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ed72c334c747c6bea0765fcc995083, user_id=f37353a79e414801aec34508311769ef, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:20.840843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5e812-ee05-424c-90b3-55a8afd0e59a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:20.853819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1236/2467] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:20 2022] PUT /identity/v3/projects/79ed72c334c747c6bea0765fcc995083/users/f37353a79e414801aec34508311769ef/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:20.865781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c1b43-80ad-468a-8fbc-49873dc46d3b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:20.866074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c1b43-80ad-468a-8fbc-49873dc46d3b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:20.866361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c1b43-80ad-468a-8fbc-49873dc46d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:20.891799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fa5c1b43-80ad-468a-8fbc-49873dc46d3b None None] MFA Rules not processed for user `f37353a79e414801aec34508311769ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:20.893027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fa5c1b43-80ad-468a-8fbc-49873dc46d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:20.954330 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1232/2468] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:20 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:20.959092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e812-ee05-424c-90b3-55a8afd0e59a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:21.017889 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e812-ee05-424c-90b3-55a8afd0e59a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:21.023092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36c759-c426-46de-93f4-677cbf5f649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:21.023728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36c759-c426-46de-93f4-677cbf5f649f admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:21.024023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36c759-c426-46de-93f4-677cbf5f649f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:21.024274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36c759-c426-46de-93f4-677cbf5f649f admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:21.025006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36c759-c426-46de-93f4-677cbf5f649f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:21.026882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36c759-c426-46de-93f4-677cbf5f649f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:21.050690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1237/2469] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:44:20 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:21.054761 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c1b43-80ad-468a-8fbc-49873dc46d3b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:21.065471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c1b43-80ad-468a-8fbc-49873dc46d3b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:21.120590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a79f7-2612-4d30-9f89-44bfb0069450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:21.121186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a79f7-2612-4d30-9f89-44bfb0069450 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:21.121466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a79f7-2612-4d30-9f89-44bfb0069450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:21.121740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a79f7-2612-4d30-9f89-44bfb0069450 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:21.122441 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a79f7-2612-4d30-9f89-44bfb0069450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:21.124392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a79f7-2612-4d30-9f89-44bfb0069450 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:21.145225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1233/2470] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:44:21 2022] POST /identity/v3/users => generated 309 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:21.149546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36c759-c426-46de-93f4-677cbf5f649f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:21.159657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36c759-c426-46de-93f4-677cbf5f649f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:21.165198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e3ff2-a209-45d4-938e-bfa6d0a66822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:21.165851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e3ff2-a209-45d4-938e-bfa6d0a66822 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:21.166131 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e3ff2-a209-45d4-938e-bfa6d0a66822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:21.166404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e3ff2-a209-45d4-938e-bfa6d0a66822 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:21.167138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e3ff2-a209-45d4-938e-bfa6d0a66822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:21.168767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e3ff2-a209-45d4-938e-bfa6d0a66822 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:21.179522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1238/2471] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:21.183951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a79f7-2612-4d30-9f89-44bfb0069450 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:21.194544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a79f7-2612-4d30-9f89-44bfb0069450 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:21.199646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71e0c-416f-4dc1-a9eb-b6c773840cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:21.200578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71e0c-416f-4dc1-a9eb-b6c773840cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:21.200855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71e0c-416f-4dc1-a9eb-b6c773840cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:21.201153 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71e0c-416f-4dc1-a9eb-b6c773840cd3 admin admin] PATH_INFO: `/v3/projects/be524d495b72484b946f828ad55b233f/users/b6911cc97c83490a91076da8ad7c2678/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:21.216591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d71e0c-416f-4dc1-a9eb-b6c773840cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be524d495b72484b946f828ad55b233f, user_id=b6911cc97c83490a91076da8ad7c2678, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:21.219212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d71e0c-416f-4dc1-a9eb-b6c773840cd3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:21.232488 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1234/2472] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:21 2022] PUT /identity/v3/projects/be524d495b72484b946f828ad55b233f/users/b6911cc97c83490a91076da8ad7c2678/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:21.236454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e3ff2-a209-45d4-938e-bfa6d0a66822 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:21.246344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e3ff2-a209-45d4-938e-bfa6d0a66822 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:21.302136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309f7a-d414-422e-a641-a01032f1d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:21.302790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309f7a-d414-422e-a641-a01032f1d15b admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:21.303067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309f7a-d414-422e-a641-a01032f1d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:21.303340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309f7a-d414-422e-a641-a01032f1d15b admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:21.304059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3309f7a-d414-422e-a641-a01032f1d15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:21.305738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3309f7a-d414-422e-a641-a01032f1d15b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:21.315065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1239/2473] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:21.319733 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71e0c-416f-4dc1-a9eb-b6c773840cd3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:21.330568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71e0c-416f-4dc1-a9eb-b6c773840cd3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:21.335831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77395338-584c-41cf-9f32-c98078d9fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:21.336743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77395338-584c-41cf-9f32-c98078d9fa86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:21.337018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77395338-584c-41cf-9f32-c98078d9fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:21.337554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77395338-584c-41cf-9f32-c98078d9fa86 admin admin] PATH_INFO: `/v3/projects/be524d495b72484b946f828ad55b233f/users/b6911cc97c83490a91076da8ad7c2678/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:21.339841 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77395338-584c-41cf-9f32-c98078d9fa86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be524d495b72484b946f828ad55b233f, user_id=b6911cc97c83490a91076da8ad7c2678, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:21.342629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77395338-584c-41cf-9f32-c98078d9fa86 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:21.353757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1235/2474] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:21 2022] PUT /identity/v3/projects/be524d495b72484b946f828ad55b233f/users/b6911cc97c83490a91076da8ad7c2678/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:21.364738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd2d8-47b3-41c4-8924-f0da8fc704c3 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:21.365026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd2d8-47b3-41c4-8924-f0da8fc704c3 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:21.365317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fd2d8-47b3-41c4-8924-f0da8fc704c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:21.394380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3f8fd2d8-47b3-41c4-8924-f0da8fc704c3 None None] MFA Rules not processed for user `b6911cc97c83490a91076da8ad7c2678`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:21.396236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3f8fd2d8-47b3-41c4-8924-f0da8fc704c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:21.463045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1240/2475] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:21 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:21.472918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77395338-584c-41cf-9f32-c98078d9fa86 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:21.474640 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-77395338-584c-41cf-9f32-c98078d9fa86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:21.529617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77395338-584c-41cf-9f32-c98078d9fa86 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:21.533249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9f6c6-828a-44e3-b5a1-335828f57adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:21.533881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9f6c6-828a-44e3-b5a1-335828f57adf service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:21.534161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9f6c6-828a-44e3-b5a1-335828f57adf service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:21.534442 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9f6c6-828a-44e3-b5a1-335828f57adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:21.543480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9f6c6-828a-44e3-b5a1-335828f57adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:21.544955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9f6c6-828a-44e3-b5a1-335828f57adf service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:21.554294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1236/2476] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:21 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:21.686894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd2d8-47b3-41c4-8924-f0da8fc704c3 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:21.696836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fd2d8-47b3-41c4-8924-f0da8fc704c3 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:21.700666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4ae2b-2fd4-4f1b-8193-25f4a85fec7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:21.701292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4ae2b-2fd4-4f1b-8193-25f4a85fec7f service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:21.701569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4ae2b-2fd4-4f1b-8193-25f4a85fec7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:21.701842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4ae2b-2fd4-4f1b-8193-25f4a85fec7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:21.754425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4ae2b-2fd4-4f1b-8193-25f4a85fec7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:21.756543 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4ae2b-2fd4-4f1b-8193-25f4a85fec7f service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:21.765077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1241/2477] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:28.927898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9f6c6-828a-44e3-b5a1-335828f57adf service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:28.999598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9f6c6-828a-44e3-b5a1-335828f57adf service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:29.004237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:29.005144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:29.005421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:29.005690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] PATH_INFO: `/v3/users/f37353a79e414801aec34508311769ef` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:29.006936 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f37353a79e414801aec34508311769ef)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:29.008879 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:29.054862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f37353a79e414801aec34508311769ef'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.061830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f37353a79e414801aec34508311769ef'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.075284 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f37353a79e414801aec34508311769ef'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.075992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f37353a79e414801aec34508311769ef'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.084338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f37353a79e414801aec34508311769ef'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.090394 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1237/2478] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:44:28 2022] DELETE /identity/v3/users/f37353a79e414801aec34508311769ef => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:29.094992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c066ade-da17-4475-a50c-0af37ddd3af2 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:29.095527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c066ade-da17-4475-a50c-0af37ddd3af2 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:29.095632 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c066ade-da17-4475-a50c-0af37ddd3af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:29.113569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3c066ade-da17-4475-a50c-0af37ddd3af2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:29.114745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3c066ade-da17-4475-a50c-0af37ddd3af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:29.171255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1242/2479] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:44:29.180790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:29.182163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:29.237284 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e92f40-9579-4735-be81-f7175924e55a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:29.240875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cf4bc-377f-4b57-852e-51a59bc057f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:29.241550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf4bc-377f-4b57-852e-51a59bc057f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:29.241825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf4bc-377f-4b57-852e-51a59bc057f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:29.242095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf4bc-377f-4b57-852e-51a59bc057f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:29.250780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cf4bc-377f-4b57-852e-51a59bc057f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:29.252189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cf4bc-377f-4b57-852e-51a59bc057f6 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:29.261438 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1238/2480] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:29.519591 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c066ade-da17-4475-a50c-0af37ddd3af2 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:29.523039 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3c066ade-da17-4475-a50c-0af37ddd3af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:29.538945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c066ade-da17-4475-a50c-0af37ddd3af2 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:29.550123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:29.550979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:29.551279 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:29.551553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] PATH_INFO: `/v3/projects/79ed72c334c747c6bea0765fcc995083` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:29.552835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ed72c334c747c6bea0765fcc995083)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:29.554783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:29.603022 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ed72c334c747c6bea0765fcc995083', 'request_id': 'req-46322922-117b-4472-8ade-0636cc466188'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.609204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ed72c334c747c6bea0765fcc995083', 'request_id': 'req-46322922-117b-4472-8ade-0636cc466188'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.617368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ed72c334c747c6bea0765fcc995083', 'request_id': 'req-46322922-117b-4472-8ade-0636cc466188'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.627670 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] The token cache is being invalidate because project 79ed72c334c747c6bea0765fcc995083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:44:29.628023 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.628725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.630802 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1243/2481] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:44:29 2022] DELETE /identity/v3/projects/79ed72c334c747c6bea0765fcc995083 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:29.634620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cf4bc-377f-4b57-852e-51a59bc057f6 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:29.644495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cf4bc-377f-4b57-852e-51a59bc057f6 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:29.707011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:29.707872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:29.708150 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:29.708460 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] PATH_INFO: `/v3/users/b6911cc97c83490a91076da8ad7c2678` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:29.709645 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6911cc97c83490a91076da8ad7c2678)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:29.711802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:29.755013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6911cc97c83490a91076da8ad7c2678'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.761639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6911cc97c83490a91076da8ad7c2678'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.773099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6911cc97c83490a91076da8ad7c2678'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.773754 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6911cc97c83490a91076da8ad7c2678'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.780761 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8e89432f-5a2c-4737-bda1-870b78ce3d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6911cc97c83490a91076da8ad7c2678'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:29.786584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1239/2482] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:44:29 2022] DELETE /identity/v3/users/b6911cc97c83490a91076da8ad7c2678 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:44:30.035199 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.036644 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:30.050106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46322922-117b-4472-8ade-0636cc466188 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.105601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.106452 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.106729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.107003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] PATH_INFO: `/v3/projects/be524d495b72484b946f828ad55b233f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.108187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be524d495b72484b946f828ad55b233f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.110123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.152921 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be524d495b72484b946f828ad55b233f', 'request_id': 'req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:30.158787 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be524d495b72484b946f828ad55b233f', 'request_id': 'req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:30.165891 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be524d495b72484b946f828ad55b233f', 'request_id': 'req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:30.175635 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] The token cache is being invalidate because project be524d495b72484b946f828ad55b233f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:44:30.175917 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:30.176573 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-01da7397-91b8-4e73-9e9e-c5ae1ff168b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:30.178079 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1244/2483] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:44:30 2022] DELETE /identity/v3/projects/be524d495b72484b946f828ad55b233f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:30.183780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51cab2-7b8d-4ecc-92ef-404bacc10d6c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.184277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51cab2-7b8d-4ecc-92ef-404bacc10d6c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.184409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51cab2-7b8d-4ecc-92ef-404bacc10d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.202281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8d51cab2-7b8d-4ecc-92ef-404bacc10d6c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:30.203453 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8d51cab2-7b8d-4ecc-92ef-404bacc10d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:30.259131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1240/2484] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:30.266913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2aaf14-bfb4-42ed-9b43-c62b94d657af None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.267201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2aaf14-bfb4-42ed-9b43-c62b94d657af None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.267477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2aaf14-bfb4-42ed-9b43-c62b94d657af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.285789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-6d2aaf14-bfb4-42ed-9b43-c62b94d657af None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:30.286966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6d2aaf14-bfb4-42ed-9b43-c62b94d657af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:30.294783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1245/2485] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:30.298837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51cab2-7b8d-4ecc-92ef-404bacc10d6c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.308234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51cab2-7b8d-4ecc-92ef-404bacc10d6c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.312884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141487f-853e-4094-9c0a-70a46303f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.313521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141487f-853e-4094-9c0a-70a46303f969 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.313798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141487f-853e-4094-9c0a-70a46303f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.314070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141487f-853e-4094-9c0a-70a46303f969 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.314790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141487f-853e-4094-9c0a-70a46303f969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:44:30.315092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141487f-853e-4094-9c0a-70a46303f969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.316698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141487f-853e-4094-9c0a-70a46303f969 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.328615 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1241/2486] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:44:30.332593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2aaf14-bfb4-42ed-9b43-c62b94d657af None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.342037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2aaf14-bfb4-42ed-9b43-c62b94d657af None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.346638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224bef-364b-412f-83bb-57af8d6f91e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.347271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224bef-364b-412f-83bb-57af8d6f91e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.347550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224bef-364b-412f-83bb-57af8d6f91e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.347824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c224bef-364b-412f-83bb-57af8d6f91e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.348561 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c224bef-364b-412f-83bb-57af8d6f91e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.350457 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c224bef-364b-412f-83bb-57af8d6f91e6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.374255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1246/2487] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:44:30 2022] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:44:30.378139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141487f-853e-4094-9c0a-70a46303f969 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.388269 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141487f-853e-4094-9c0a-70a46303f969 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.440985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e3bef-5fb7-45d8-a751-b3f7c79b547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.441567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3bef-5fb7-45d8-a751-b3f7c79b547b admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.441848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3bef-5fb7-45d8-a751-b3f7c79b547b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.442120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3bef-5fb7-45d8-a751-b3f7c79b547b admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.442825 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e3bef-5fb7-45d8-a751-b3f7c79b547b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.445281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e3bef-5fb7-45d8-a751-b3f7c79b547b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.468106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1242/2488] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:44:30 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:44:30.469446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224bef-364b-412f-83bb-57af8d6f91e6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.480890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c224bef-364b-412f-83bb-57af8d6f91e6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.485912 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1e8ae-7c5c-40d3-8843-03bcaa0d97d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.486568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e8ae-7c5c-40d3-8843-03bcaa0d97d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.486845 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e8ae-7c5c-40d3-8843-03bcaa0d97d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.487113 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1e8ae-7c5c-40d3-8843-03bcaa0d97d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.487834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1e8ae-7c5c-40d3-8843-03bcaa0d97d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.489683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1e8ae-7c5c-40d3-8843-03bcaa0d97d6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.500088 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1247/2489] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:44:30.504126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e3bef-5fb7-45d8-a751-b3f7c79b547b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.514727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e3bef-5fb7-45d8-a751-b3f7c79b547b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.519395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35456d8-2d2e-4786-a032-d4d055e04b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.520038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35456d8-2d2e-4786-a032-d4d055e04b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.520317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35456d8-2d2e-4786-a032-d4d055e04b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.520625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35456d8-2d2e-4786-a032-d4d055e04b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.521384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35456d8-2d2e-4786-a032-d4d055e04b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.527559 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35456d8-2d2e-4786-a032-d4d055e04b47 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.541105 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1243/2490] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:44:30.546063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1e8ae-7c5c-40d3-8843-03bcaa0d97d6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.555741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1e8ae-7c5c-40d3-8843-03bcaa0d97d6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.560522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90887e66-35c4-43c2-bf62-25e4f94a882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.561395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90887e66-35c4-43c2-bf62-25e4f94a882e admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.561812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90887e66-35c4-43c2-bf62-25e4f94a882e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.562086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90887e66-35c4-43c2-bf62-25e4f94a882e admin admin] PATH_INFO: `/v3/projects/951a8022f98d446d92f7c2217786b618/users/c38d9e8377094dabb89e45a134f9db3a/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.577123 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90887e66-35c4-43c2-bf62-25e4f94a882e admin admin] RBAC: Authorizing `identity:create_grant(project_id=951a8022f98d446d92f7c2217786b618, user_id=c38d9e8377094dabb89e45a134f9db3a, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.579731 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90887e66-35c4-43c2-bf62-25e4f94a882e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.592538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1248/2491] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:30 2022] PUT /identity/v3/projects/951a8022f98d446d92f7c2217786b618/users/c38d9e8377094dabb89e45a134f9db3a/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:30.605517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189299ba-9529-4c54-b211-d43756c06968 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.606019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189299ba-9529-4c54-b211-d43756c06968 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.606489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189299ba-9529-4c54-b211-d43756c06968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.633534 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-189299ba-9529-4c54-b211-d43756c06968 None None] MFA Rules not processed for user `c38d9e8377094dabb89e45a134f9db3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:30.634730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-189299ba-9529-4c54-b211-d43756c06968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:30.701794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1244/2492] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:30.702906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90887e66-35c4-43c2-bf62-25e4f94a882e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.764619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90887e66-35c4-43c2-bf62-25e4f94a882e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.769259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb9cc8-2e8e-4f0c-97e4-3d9ff7436f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.769960 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb9cc8-2e8e-4f0c-97e4-3d9ff7436f2d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.770321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb9cc8-2e8e-4f0c-97e4-3d9ff7436f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.770594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb9cc8-2e8e-4f0c-97e4-3d9ff7436f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.771324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb9cc8-2e8e-4f0c-97e4-3d9ff7436f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.773827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb9cc8-2e8e-4f0c-97e4-3d9ff7436f2d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.799928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1249/2493] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:44:30 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:44:30.805585 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189299ba-9529-4c54-b211-d43756c06968 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.814962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189299ba-9529-4c54-b211-d43756c06968 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.869129 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f8836-cf6d-4bc1-9389-ff21efce38fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.869789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f8836-cf6d-4bc1-9389-ff21efce38fe admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.870071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f8836-cf6d-4bc1-9389-ff21efce38fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.870345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f8836-cf6d-4bc1-9389-ff21efce38fe admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.871051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f8836-cf6d-4bc1-9389-ff21efce38fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.873045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f8836-cf6d-4bc1-9389-ff21efce38fe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.892704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1245/2494] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:44:30 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:30.896320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb9cc8-2e8e-4f0c-97e4-3d9ff7436f2d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.906586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb9cc8-2e8e-4f0c-97e4-3d9ff7436f2d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.911157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b9d7-2191-40bb-8c3b-4fbf21887e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.911801 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b9d7-2191-40bb-8c3b-4fbf21887e86 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.912082 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b9d7-2191-40bb-8c3b-4fbf21887e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.912380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5b9d7-2191-40bb-8c3b-4fbf21887e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.913111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5b9d7-2191-40bb-8c3b-4fbf21887e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.914704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5b9d7-2191-40bb-8c3b-4fbf21887e86 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.924306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1250/2495] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:30.927938 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f8836-cf6d-4bc1-9389-ff21efce38fe admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.938204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f8836-cf6d-4bc1-9389-ff21efce38fe admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.942772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0028e6-f97b-43fd-b6dd-aac049c70a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.943409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0028e6-f97b-43fd-b6dd-aac049c70a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.943691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0028e6-f97b-43fd-b6dd-aac049c70a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.944023 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0028e6-f97b-43fd-b6dd-aac049c70a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.945280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0028e6-f97b-43fd-b6dd-aac049c70a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.946842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0028e6-f97b-43fd-b6dd-aac049c70a9a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:30.956793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1246/2496] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:30.960624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b9d7-2191-40bb-8c3b-4fbf21887e86 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:30.970295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5b9d7-2191-40bb-8c3b-4fbf21887e86 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:30.974982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d29210-df1d-42ec-a8f7-dd454730e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:30.976425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29210-df1d-42ec-a8f7-dd454730e83c admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:30.976703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29210-df1d-42ec-a8f7-dd454730e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:30.976973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d29210-df1d-42ec-a8f7-dd454730e83c admin admin] PATH_INFO: `/v3/projects/cb0fc0c48b4d4047b29a4d9fa504de63/users/35ed70b683db4383a043e6643d8c2c50/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:30.992291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d29210-df1d-42ec-a8f7-dd454730e83c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0fc0c48b4d4047b29a4d9fa504de63, user_id=35ed70b683db4383a043e6643d8c2c50, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:30.994930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d29210-df1d-42ec-a8f7-dd454730e83c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:31.006869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1251/2497] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:30 2022] PUT /identity/v3/projects/cb0fc0c48b4d4047b29a4d9fa504de63/users/35ed70b683db4383a043e6643d8c2c50/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:31.016909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555eba9-c9b2-4759-bfdc-6b9c4abc2416 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.017199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555eba9-c9b2-4759-bfdc-6b9c4abc2416 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.017477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555eba9-c9b2-4759-bfdc-6b9c4abc2416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.043667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c555eba9-c9b2-4759-bfdc-6b9c4abc2416 None None] MFA Rules not processed for user `35ed70b683db4383a043e6643d8c2c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:31.044914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c555eba9-c9b2-4759-bfdc-6b9c4abc2416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:31.107223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1247/2498] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:31.111721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d29210-df1d-42ec-a8f7-dd454730e83c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:31.171208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d29210-df1d-42ec-a8f7-dd454730e83c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:31.175876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684fc9-7f9a-4b99-9a25-9d91b99d272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:31.176545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684fc9-7f9a-4b99-9a25-9d91b99d272a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.176824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684fc9-7f9a-4b99-9a25-9d91b99d272a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.177098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684fc9-7f9a-4b99-9a25-9d91b99d272a admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.177798 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d684fc9-7f9a-4b99-9a25-9d91b99d272a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:31.180271 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d684fc9-7f9a-4b99-9a25-9d91b99d272a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:31.203909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1252/2499] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:44:31 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:31.207892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555eba9-c9b2-4759-bfdc-6b9c4abc2416 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:31.218626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555eba9-c9b2-4759-bfdc-6b9c4abc2416 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:31.271811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35422-1d9e-4d06-aa4b-144c9c2726da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:31.272504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35422-1d9e-4d06-aa4b-144c9c2726da admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.272781 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35422-1d9e-4d06-aa4b-144c9c2726da admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.273052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec35422-1d9e-4d06-aa4b-144c9c2726da admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.273750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35422-1d9e-4d06-aa4b-144c9c2726da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:31.275657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec35422-1d9e-4d06-aa4b-144c9c2726da admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:31.294516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1248/2500] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:44:31 2022] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:31.298397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684fc9-7f9a-4b99-9a25-9d91b99d272a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:31.309115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684fc9-7f9a-4b99-9a25-9d91b99d272a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:31.313904 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ecb9-9370-47eb-be03-85f3d322bce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:31.314574 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ecb9-9370-47eb-be03-85f3d322bce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.314849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ecb9-9370-47eb-be03-85f3d322bce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.315117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52ecb9-9370-47eb-be03-85f3d322bce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.315835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ecb9-9370-47eb-be03-85f3d322bce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:31.317516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52ecb9-9370-47eb-be03-85f3d322bce8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:31.327929 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1253/2501] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:31.331886 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35422-1d9e-4d06-aa4b-144c9c2726da admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:31.341652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec35422-1d9e-4d06-aa4b-144c9c2726da admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:31.346274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf7955-ac5a-4e52-92e7-43007c3aa6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:31.347134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf7955-ac5a-4e52-92e7-43007c3aa6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.347414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf7955-ac5a-4e52-92e7-43007c3aa6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.347688 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf7955-ac5a-4e52-92e7-43007c3aa6f4 admin admin] PATH_INFO: `/v3/projects/6eabbd96590e4be3be899c8f8c6c948b/users/1031fcd08a774c28866a353bdaab5285/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.362247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf7955-ac5a-4e52-92e7-43007c3aa6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eabbd96590e4be3be899c8f8c6c948b, user_id=1031fcd08a774c28866a353bdaab5285, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:31.364918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf7955-ac5a-4e52-92e7-43007c3aa6f4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:31.378327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1249/2502] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:31 2022] PUT /identity/v3/projects/6eabbd96590e4be3be899c8f8c6c948b/users/1031fcd08a774c28866a353bdaab5285/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:31.382215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ecb9-9370-47eb-be03-85f3d322bce8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:31.392080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52ecb9-9370-47eb-be03-85f3d322bce8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:31.445051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6b8eb-1226-41b4-9958-7115c4feac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:31.445694 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6b8eb-1226-41b4-9958-7115c4feac7c admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.445970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6b8eb-1226-41b4-9958-7115c4feac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.446241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6b8eb-1226-41b4-9958-7115c4feac7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.446955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6b8eb-1226-41b4-9958-7115c4feac7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:31.448831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6b8eb-1226-41b4-9958-7115c4feac7c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:31.458302 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1254/2503] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:31.462951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf7955-ac5a-4e52-92e7-43007c3aa6f4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:31.474267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf7955-ac5a-4e52-92e7-43007c3aa6f4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:31.479511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec25ada-5bdb-44d7-ae48-0adec259fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:31.480445 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec25ada-5bdb-44d7-ae48-0adec259fe25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.480725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec25ada-5bdb-44d7-ae48-0adec259fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.480995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec25ada-5bdb-44d7-ae48-0adec259fe25 admin admin] PATH_INFO: `/v3/projects/6eabbd96590e4be3be899c8f8c6c948b/users/1031fcd08a774c28866a353bdaab5285/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.482974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec25ada-5bdb-44d7-ae48-0adec259fe25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eabbd96590e4be3be899c8f8c6c948b, user_id=1031fcd08a774c28866a353bdaab5285, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:31.485635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec25ada-5bdb-44d7-ae48-0adec259fe25 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:31.496835 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1250/2504] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:31 2022] PUT /identity/v3/projects/6eabbd96590e4be3be899c8f8c6c948b/users/1031fcd08a774c28866a353bdaab5285/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:31.506564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd215c1-3cfa-4a0c-a6b3-52e3d6963b7a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.506850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd215c1-3cfa-4a0c-a6b3-52e3d6963b7a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.507197 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd215c1-3cfa-4a0c-a6b3-52e3d6963b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.535186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-dbd215c1-3cfa-4a0c-a6b3-52e3d6963b7a None None] MFA Rules not processed for user `1031fcd08a774c28866a353bdaab5285`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:31.536406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dbd215c1-3cfa-4a0c-a6b3-52e3d6963b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:31.602453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1255/2505] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:31.612317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec25ada-5bdb-44d7-ae48-0adec259fe25 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:31.614002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4ec25ada-5bdb-44d7-ae48-0adec259fe25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:31.668273 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec25ada-5bdb-44d7-ae48-0adec259fe25 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:31.671884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa04d-8d9e-452d-a481-a3e9db103b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:31.672553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa04d-8d9e-452d-a481-a3e9db103b53 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.672833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa04d-8d9e-452d-a481-a3e9db103b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.673103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa04d-8d9e-452d-a481-a3e9db103b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.682037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa04d-8d9e-452d-a481-a3e9db103b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:31.683461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa04d-8d9e-452d-a481-a3e9db103b53 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:31.692647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1251/2506] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:31.733711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd215c1-3cfa-4a0c-a6b3-52e3d6963b7a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:31.743083 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd215c1-3cfa-4a0c-a6b3-52e3d6963b7a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:31.746600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82116a1b-7ea3-4a1f-87a6-7fc70e8d0ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:31.747223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82116a1b-7ea3-4a1f-87a6-7fc70e8d0ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:31.747493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82116a1b-7ea3-4a1f-87a6-7fc70e8d0ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:31.747760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82116a1b-7ea3-4a1f-87a6-7fc70e8d0ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:31.801952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82116a1b-7ea3-4a1f-87a6-7fc70e8d0ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:31.803379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82116a1b-7ea3-4a1f-87a6-7fc70e8d0ed0 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:31.812064 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1256/2507] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:34.595830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa04d-8d9e-452d-a481-a3e9db103b53 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:34.659100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa04d-8d9e-452d-a481-a3e9db103b53 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:34.663829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:34.664784 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:34.665060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:34.665328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] PATH_INFO: `/v3/users/c38d9e8377094dabb89e45a134f9db3a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:34.666504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38d9e8377094dabb89e45a134f9db3a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:34.668419 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:34.712882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38d9e8377094dabb89e45a134f9db3a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:34.719360 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38d9e8377094dabb89e45a134f9db3a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:34.731024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38d9e8377094dabb89e45a134f9db3a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:34.731675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38d9e8377094dabb89e45a134f9db3a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:34.739455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38d9e8377094dabb89e45a134f9db3a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:34.745928 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1252/2508] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:44:34 2022] DELETE /identity/v3/users/c38d9e8377094dabb89e45a134f9db3a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:34.750643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480de6-7776-438b-a867-33749e8ef99b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:34.751115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480de6-7776-438b-a867-33749e8ef99b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:34.751231 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480de6-7776-438b-a867-33749e8ef99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:34.768274 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-37480de6-7776-438b-a867-33749e8ef99b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:34.769497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-37480de6-7776-438b-a867-33749e8ef99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:34.825890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1257/2509] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:34.835348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:34.837152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:34.893118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58981fc9-ed0f-4d35-866b-446ce2c4ac3e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:34.896776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402efc-7e56-40f9-8f70-d1a03bfa7d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:34.897412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402efc-7e56-40f9-8f70-d1a03bfa7d45 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:34.897693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402efc-7e56-40f9-8f70-d1a03bfa7d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:34.897960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5402efc-7e56-40f9-8f70-d1a03bfa7d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:34.906695 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402efc-7e56-40f9-8f70-d1a03bfa7d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:34.908113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5402efc-7e56-40f9-8f70-d1a03bfa7d45 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:34.918060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1253/2510] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:44:35.186289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37480de6-7776-438b-a867-33749e8ef99b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:35.187682 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-37480de6-7776-438b-a867-33749e8ef99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:35.199634 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37480de6-7776-438b-a867-33749e8ef99b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:35.204316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:35.205186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:35.205461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:35.205730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] PATH_INFO: `/v3/projects/951a8022f98d446d92f7c2217786b618` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:35.207027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=951a8022f98d446d92f7c2217786b618)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:35.208836 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:35.254061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951a8022f98d446d92f7c2217786b618', 'request_id': 'req-a0e0039d-778f-4b75-bf5b-0208b2ec7430'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.259985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951a8022f98d446d92f7c2217786b618', 'request_id': 'req-a0e0039d-778f-4b75-bf5b-0208b2ec7430'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.266984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951a8022f98d446d92f7c2217786b618', 'request_id': 'req-a0e0039d-778f-4b75-bf5b-0208b2ec7430'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.277546 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] The token cache is being invalidate because project 951a8022f98d446d92f7c2217786b618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:44:35.277839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.278575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.280111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1258/2511] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:44:35 2022] DELETE /identity/v3/projects/951a8022f98d446d92f7c2217786b618 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:35.284215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402efc-7e56-40f9-8f70-d1a03bfa7d45 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:35.294364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5402efc-7e56-40f9-8f70-d1a03bfa7d45 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:35.347882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:35.348761 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:35.349037 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:35.349312 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] PATH_INFO: `/v3/users/35ed70b683db4383a043e6643d8c2c50` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:35.350495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35ed70b683db4383a043e6643d8c2c50)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:35.353049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:35.394871 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35ed70b683db4383a043e6643d8c2c50'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.402070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35ed70b683db4383a043e6643d8c2c50'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.413483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35ed70b683db4383a043e6643d8c2c50'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.414757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35ed70b683db4383a043e6643d8c2c50'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.420976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35ed70b683db4383a043e6643d8c2c50'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.426844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1254/2512] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:44:35 2022] DELETE /identity/v3/users/35ed70b683db4383a043e6643d8c2c50 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:35.684293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:35.685924 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:35.704936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0039d-778f-4b75-bf5b-0208b2ec7430 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:35.758770 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:35.759662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:35.759937 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:35.760204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] PATH_INFO: `/v3/projects/cb0fc0c48b4d4047b29a4d9fa504de63` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:35.761462 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0fc0c48b4d4047b29a4d9fa504de63)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:35.763365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:35.807524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0fc0c48b4d4047b29a4d9fa504de63', 'request_id': 'req-b204d262-5e43-4654-91b5-b26297e77120'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.813258 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0fc0c48b4d4047b29a4d9fa504de63', 'request_id': 'req-b204d262-5e43-4654-91b5-b26297e77120'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.819992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0fc0c48b4d4047b29a4d9fa504de63', 'request_id': 'req-b204d262-5e43-4654-91b5-b26297e77120'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.830628 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] The token cache is being invalidate because project cb0fc0c48b4d4047b29a4d9fa504de63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:44:35.830908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.831505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.833039 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1259/2513] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:44:35 2022] DELETE /identity/v3/projects/cb0fc0c48b4d4047b29a4d9fa504de63 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:35.837519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:35.838892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:35.851347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c135c1-a8c1-4c01-8855-3a6f4e1bec96 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:35.904947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:35.905795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:35.906074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:35.906346 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] PATH_INFO: `/v3/users/1031fcd08a774c28866a353bdaab5285` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:35.907524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1031fcd08a774c28866a353bdaab5285)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:35.909467 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:35.952410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1031fcd08a774c28866a353bdaab5285'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.958969 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1031fcd08a774c28866a353bdaab5285'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.970802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1031fcd08a774c28866a353bdaab5285'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.971485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1031fcd08a774c28866a353bdaab5285'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.978304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3b77873a-1881-453d-8ea9-0fbba4ee86f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1031fcd08a774c28866a353bdaab5285'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:35.984183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1255/2514] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:44:35 2022] DELETE /identity/v3/users/1031fcd08a774c28866a353bdaab5285 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:36.243037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:36.244598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:36.257065 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204d262-5e43-4654-91b5-b26297e77120 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:36.312121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:36.313005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.313287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.313557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] PATH_INFO: `/v3/projects/6eabbd96590e4be3be899c8f8c6c948b` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.314738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eabbd96590e4be3be899c8f8c6c948b)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:36.316692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:36.359949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eabbd96590e4be3be899c8f8c6c948b', 'request_id': 'req-29f3f854-1b74-416b-b278-af43120efd07'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:36.365847 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eabbd96590e4be3be899c8f8c6c948b', 'request_id': 'req-29f3f854-1b74-416b-b278-af43120efd07'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:36.373660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eabbd96590e4be3be899c8f8c6c948b', 'request_id': 'req-29f3f854-1b74-416b-b278-af43120efd07'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:36.384019 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] The token cache is being invalidate because project 6eabbd96590e4be3be899c8f8c6c948b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:44:36.384304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:36.384949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-29f3f854-1b74-416b-b278-af43120efd07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:44:36.386469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1260/2515] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:44:36 2022] DELETE /identity/v3/projects/6eabbd96590e4be3be899c8f8c6c948b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:36.393270 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3e69-052d-48d8-9d3c-85d5bf0c8ef8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.393680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3e69-052d-48d8-9d3c-85d5bf0c8ef8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.394028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c3e69-052d-48d8-9d3c-85d5bf0c8ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.411942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-026c3e69-052d-48d8-9d3c-85d5bf0c8ef8 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:36.413185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-026c3e69-052d-48d8-9d3c-85d5bf0c8ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:36.471482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1256/2516] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:36.480408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d093c36-beee-4692-9e75-1f040666508e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.480700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d093c36-beee-4692-9e75-1f040666508e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.480980 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d093c36-beee-4692-9e75-1f040666508e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.499307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0d093c36-beee-4692-9e75-1f040666508e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:36.500652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0d093c36-beee-4692-9e75-1f040666508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:36.508638 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1261/2517] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:36.512649 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c3e69-052d-48d8-9d3c-85d5bf0c8ef8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:36.522177 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c3e69-052d-48d8-9d3c-85d5bf0c8ef8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:36.526793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604b3e-cace-4873-a7db-8775584c078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:36.527431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604b3e-cace-4873-a7db-8775584c078f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.527705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604b3e-cace-4873-a7db-8775584c078f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.527971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604b3e-cace-4873-a7db-8775584c078f admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.528720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604b3e-cace-4873-a7db-8775584c078f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:44:36.529021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604b3e-cace-4873-a7db-8775584c078f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:36.530608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604b3e-cace-4873-a7db-8775584c078f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:36.542194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1257/2518] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:44:36.546594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d093c36-beee-4692-9e75-1f040666508e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:36.556084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d093c36-beee-4692-9e75-1f040666508e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:36.560712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979990d-7314-40e9-ae8b-ee3a5394992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:36.561339 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979990d-7314-40e9-ae8b-ee3a5394992b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.561616 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979990d-7314-40e9-ae8b-ee3a5394992b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.561892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979990d-7314-40e9-ae8b-ee3a5394992b admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.562597 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979990d-7314-40e9-ae8b-ee3a5394992b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:36.564522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979990d-7314-40e9-ae8b-ee3a5394992b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:36.589632 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1262/2519] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:44:36 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:36.593524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604b3e-cace-4873-a7db-8775584c078f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:36.603864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604b3e-cace-4873-a7db-8775584c078f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:36.790294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d527dc-6fea-4fa8-8f6b-24a807af9f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:36.790956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d527dc-6fea-4fa8-8f6b-24a807af9f68 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.791238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d527dc-6fea-4fa8-8f6b-24a807af9f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.791513 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d527dc-6fea-4fa8-8f6b-24a807af9f68 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.792219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d527dc-6fea-4fa8-8f6b-24a807af9f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:36.794163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d527dc-6fea-4fa8-8f6b-24a807af9f68 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:36.812805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1258/2520] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:44:36 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:44:36.816882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979990d-7314-40e9-ae8b-ee3a5394992b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:36.827584 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979990d-7314-40e9-ae8b-ee3a5394992b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:36.831975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841089d5-59c1-440e-b4fc-e7066e5ef394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:36.832654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841089d5-59c1-440e-b4fc-e7066e5ef394 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.832928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841089d5-59c1-440e-b4fc-e7066e5ef394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.833199 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841089d5-59c1-440e-b4fc-e7066e5ef394 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.833917 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841089d5-59c1-440e-b4fc-e7066e5ef394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:36.835505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841089d5-59c1-440e-b4fc-e7066e5ef394 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:36.845450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1263/2521] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:36.849146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d527dc-6fea-4fa8-8f6b-24a807af9f68 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:36.858689 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d527dc-6fea-4fa8-8f6b-24a807af9f68 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:36.863178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21471d2-9e85-4a19-959b-1fa1bfabba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:36.863814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21471d2-9e85-4a19-959b-1fa1bfabba6e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.864088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21471d2-9e85-4a19-959b-1fa1bfabba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.864384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21471d2-9e85-4a19-959b-1fa1bfabba6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.865116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21471d2-9e85-4a19-959b-1fa1bfabba6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:36.866663 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21471d2-9e85-4a19-959b-1fa1bfabba6e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:36.876794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1259/2522] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:44:36.880577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841089d5-59c1-440e-b4fc-e7066e5ef394 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:36.891014 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841089d5-59c1-440e-b4fc-e7066e5ef394 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:36.895476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc841323-2871-4fb2-abbe-b622cc7aea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:36.896323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc841323-2871-4fb2-abbe-b622cc7aea3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.896732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc841323-2871-4fb2-abbe-b622cc7aea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.897008 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc841323-2871-4fb2-abbe-b622cc7aea3e admin admin] PATH_INFO: `/v3/projects/8e4f247639f048bea0218c27d183aef3/users/7ea08aea0bb04cac81c78c7c2c407fb6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.910969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc841323-2871-4fb2-abbe-b622cc7aea3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4f247639f048bea0218c27d183aef3, user_id=7ea08aea0bb04cac81c78c7c2c407fb6, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:36.913614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc841323-2871-4fb2-abbe-b622cc7aea3e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:36.925921 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1264/2523] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:44:36 2022] PUT /identity/v3/projects/8e4f247639f048bea0218c27d183aef3/users/7ea08aea0bb04cac81c78c7c2c407fb6/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:44:36.937361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0577d-d91f-43dc-ba75-860da97899a5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:36.937591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0577d-d91f-43dc-ba75-860da97899a5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:36.937864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0577d-d91f-43dc-ba75-860da97899a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:36.964038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b1d0577d-d91f-43dc-ba75-860da97899a5 None None] MFA Rules not processed for user `7ea08aea0bb04cac81c78c7c2c407fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:36.965276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b1d0577d-d91f-43dc-ba75-860da97899a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:37.025684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1260/2524] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:44:37.035372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc841323-2871-4fb2-abbe-b622cc7aea3e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:37.037050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-fc841323-2871-4fb2-abbe-b622cc7aea3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:37.091195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc841323-2871-4fb2-abbe-b622cc7aea3e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:37.094828 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbefed5-2841-4822-ac0f-1b540b65420c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:37.095456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbefed5-2841-4822-ac0f-1b540b65420c service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:37.095727 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbefed5-2841-4822-ac0f-1b540b65420c service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:37.095996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbefed5-2841-4822-ac0f-1b540b65420c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:37.104555 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbefed5-2841-4822-ac0f-1b540b65420c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:37.105975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbefed5-2841-4822-ac0f-1b540b65420c service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:37.114664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1265/2525] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:44:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:44:38.235371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb417a3-659b-45f0-88e5-d2684a589ba6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:38.235858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb417a3-659b-45f0-88e5-d2684a589ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:38.235963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb417a3-659b-45f0-88e5-d2684a589ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:38.253638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-adb417a3-659b-45f0-88e5-d2684a589ba6 None None] MFA Rules not processed for user `92f4a8bb9b7c42b09b79fd5a56af9bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:38.254837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-adb417a3-659b-45f0-88e5-d2684a589ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:38.309529 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1261/2526] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:38.443693 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ddeee-7f28-4dc7-b68c-59a61b39e04e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:38.444202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ddeee-7f28-4dc7-b68c-59a61b39e04e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:38.444295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ddeee-7f28-4dc7-b68c-59a61b39e04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:38.462217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-bf1ddeee-7f28-4dc7-b68c-59a61b39e04e None None] MFA Rules not processed for user `7ea08aea0bb04cac81c78c7c2c407fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:38.463409 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bf1ddeee-7f28-4dc7-b68c-59a61b39e04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:38.470762 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1266/2527] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:50.305501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac263e-b815-4df4-afd9-3f1de40dd20e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:50.305977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac263e-b815-4df4-afd9-3f1de40dd20e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:50.306070 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac263e-b815-4df4-afd9-3f1de40dd20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:50.324183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d9ac263e-b815-4df4-afd9-3f1de40dd20e None None] MFA Rules not processed for user `4a6e100dfcd5498fa5e2a5a1b04429dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:50.325332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d9ac263e-b815-4df4-afd9-3f1de40dd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:50.376575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1262/2528] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:54.981529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4dc74-5645-47c5-aa3d-cff58e974aed None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:54.982047 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4dc74-5645-47c5-aa3d-cff58e974aed None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:54.982152 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4dc74-5645-47c5-aa3d-cff58e974aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:55.038378 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5be4dc74-5645-47c5-aa3d-cff58e974aed None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:55.039580 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5be4dc74-5645-47c5-aa3d-cff58e974aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:55.100156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1267/2529] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:44:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:55.146092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac263e-b815-4df4-afd9-3f1de40dd20e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:55.147588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d9ac263e-b815-4df4-afd9-3f1de40dd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:55.234724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac263e-b815-4df4-afd9-3f1de40dd20e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:55.239673 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1785-4fa6-4f64-9ea1-9d19ee8c00b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:55.240308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1785-4fa6-4f64-9ea1-9d19ee8c00b5 service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:55.240632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1785-4fa6-4f64-9ea1-9d19ee8c00b5 service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:55.240907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d1785-4fa6-4f64-9ea1-9d19ee8c00b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:55.249386 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d1785-4fa6-4f64-9ea1-9d19ee8c00b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:55.250952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d1785-4fa6-4f64-9ea1-9d19ee8c00b5 service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:55.258821 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1263/2530] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:44:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:44:55.738422 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e2cda-e936-48f7-929c-a361d33f0c9e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:55.738708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e2cda-e936-48f7-929c-a361d33f0c9e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:55.738983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e2cda-e936-48f7-929c-a361d33f0c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:55.756048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0a0e2cda-e936-48f7-929c-a361d33f0c9e None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:55.757830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0a0e2cda-e936-48f7-929c-a361d33f0c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:55.764781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1268/2531] 10.222.0.15 () {58 vars in 967 bytes} [Mon Feb 7 02:44:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:55.777426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1785-4fa6-4f64-9ea1-9d19ee8c00b5 service swift] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:55.787404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d1785-4fa6-4f64-9ea1-9d19ee8c00b5 service swift] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:55.792802 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7a518-a2fa-4aa0-b3f8-8640e200f98a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:55.793550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7a518-a2fa-4aa0-b3f8-8640e200f98a service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:55.794004 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7a518-a2fa-4aa0-b3f8-8640e200f98a service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:55.794288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7a518-a2fa-4aa0-b3f8-8640e200f98a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:55.802549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7a518-a2fa-4aa0-b3f8-8640e200f98a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:55.804322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7a518-a2fa-4aa0-b3f8-8640e200f98a service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:55.814489 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1264/2532] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:44:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 02:44:56.022160 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1d252-bf1b-4fe7-ae4f-c08582594b1c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:56.022755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1d252-bf1b-4fe7-ae4f-c08582594b1c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:56.022755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1d252-bf1b-4fe7-ae4f-c08582594b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:56.043716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-66f1d252-bf1b-4fe7-ae4f-c08582594b1c None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:56.045049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-66f1d252-bf1b-4fe7-ae4f-c08582594b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:56.052838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1269/2533] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:44:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:44:56.065277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7a518-a2fa-4aa0-b3f8-8640e200f98a service swift] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:56.076888 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7a518-a2fa-4aa0-b3f8-8640e200f98a service swift] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:56.082058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430aef5-b3db-4da7-94b7-eb17ea48322c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:56.082705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430aef5-b3db-4da7-94b7-eb17ea48322c service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:56.083180 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430aef5-b3db-4da7-94b7-eb17ea48322c service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:56.083455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430aef5-b3db-4da7-94b7-eb17ea48322c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:56.092881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430aef5-b3db-4da7-94b7-eb17ea48322c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:56.094455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430aef5-b3db-4da7-94b7-eb17ea48322c service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:56.104362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1265/2534] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:44:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:44:56.423771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9fe9f-a87c-4e28-8e10-43cf78063707 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:56.424054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9fe9f-a87c-4e28-8e10-43cf78063707 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:56.424330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9fe9f-a87c-4e28-8e10-43cf78063707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:56.442042 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-70f9fe9f-a87c-4e28-8e10-43cf78063707 None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:44:56.443219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-70f9fe9f-a87c-4e28-8e10-43cf78063707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:44:56.451121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1270/2535] 10.222.0.15 () {58 vars in 967 bytes} [Mon Feb 7 02:44:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:44:56.462875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430aef5-b3db-4da7-94b7-eb17ea48322c service swift] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:44:56.473266 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430aef5-b3db-4da7-94b7-eb17ea48322c service swift] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:44:56.478995 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca0504-46e9-4f3f-899b-241cdbf58118 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:44:56.479622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca0504-46e9-4f3f-899b-241cdbf58118 service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:44:56.479900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca0504-46e9-4f3f-899b-241cdbf58118 service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:44:56.480175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca0504-46e9-4f3f-899b-241cdbf58118 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:44:56.488086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca0504-46e9-4f3f-899b-241cdbf58118 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:44:56.489707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca0504-46e9-4f3f-899b-241cdbf58118 service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:44:56.498347 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1266/2536] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:44:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:45:00.583215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9fe9f-a87c-4e28-8e10-43cf78063707 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:00.642120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9fe9f-a87c-4e28-8e10-43cf78063707 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:00.646552 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:00.647400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:00.648185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:00.648521 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] PATH_INFO: `/v3/users/7ea08aea0bb04cac81c78c7c2c407fb6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:00.649706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea08aea0bb04cac81c78c7c2c407fb6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:00.651603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:00.698374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea08aea0bb04cac81c78c7c2c407fb6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:00.706937 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea08aea0bb04cac81c78c7c2c407fb6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:00.714760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea08aea0bb04cac81c78c7c2c407fb6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:00.725798 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea08aea0bb04cac81c78c7c2c407fb6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:00.727053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea08aea0bb04cac81c78c7c2c407fb6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:00.732790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1271/2537] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:45:00 2022] DELETE /identity/v3/users/7ea08aea0bb04cac81c78c7c2c407fb6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:45:00.737227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213d930-fc2b-4734-9305-5031c5e6c907 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:00.737696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213d930-fc2b-4734-9305-5031c5e6c907 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:00.737793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213d930-fc2b-4734-9305-5031c5e6c907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:00.754507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d213d930-fc2b-4734-9305-5031c5e6c907 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:00.755669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d213d930-fc2b-4734-9305-5031c5e6c907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:00.811720 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1267/2538] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:45:00.837512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:00.839062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:00.895810 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf1e10-f1ba-4148-8fe6-d20b3c18a5e2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:00.899890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d2968-1fe6-45e3-911f-483b9acd2691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:00.900666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d2968-1fe6-45e3-911f-483b9acd2691 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:00.900949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d2968-1fe6-45e3-911f-483b9acd2691 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:00.901218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d2968-1fe6-45e3-911f-483b9acd2691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:00.910722 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d2968-1fe6-45e3-911f-483b9acd2691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:00.912212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d2968-1fe6-45e3-911f-483b9acd2691 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:00.922515 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1272/2539] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:45:01.081065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213d930-fc2b-4734-9305-5031c5e6c907 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:01.082576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d213d930-fc2b-4734-9305-5031c5e6c907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:01.096864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213d930-fc2b-4734-9305-5031c5e6c907 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:01.102068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:01.103311 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.103485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.103751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] PATH_INFO: `/v3/projects/8e4f247639f048bea0218c27d183aef3` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.105008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4f247639f048bea0218c27d183aef3)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:01.107604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:01.155977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4f247639f048bea0218c27d183aef3', 'request_id': 'req-1e95b463-29be-4f7e-815f-a7f3be3158b4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:01.162213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4f247639f048bea0218c27d183aef3', 'request_id': 'req-1e95b463-29be-4f7e-815f-a7f3be3158b4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:01.167666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4f247639f048bea0218c27d183aef3', 'request_id': 'req-1e95b463-29be-4f7e-815f-a7f3be3158b4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:01.180375 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] The token cache is being invalidate because project 8e4f247639f048bea0218c27d183aef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:45:01.180662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:01.181274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1e95b463-29be-4f7e-815f-a7f3be3158b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:01.182839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1268/2540] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:45:01 2022] DELETE /identity/v3/projects/8e4f247639f048bea0218c27d183aef3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:45:01.188624 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf3af-ea23-40f2-a22f-babe0d6b0b33 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.188936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf3af-ea23-40f2-a22f-babe0d6b0b33 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.189215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaf3af-ea23-40f2-a22f-babe0d6b0b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.210760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-eeaaf3af-ea23-40f2-a22f-babe0d6b0b33 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:01.212092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-eeaaf3af-ea23-40f2-a22f-babe0d6b0b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:01.278785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1273/2541] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:45:01.287763 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393d419-6a4e-4bd3-981c-2d229e245894 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.288119 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393d419-6a4e-4bd3-981c-2d229e245894 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.288584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393d419-6a4e-4bd3-981c-2d229e245894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.306329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1393d419-6a4e-4bd3-981c-2d229e245894 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:01.307503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1393d419-6a4e-4bd3-981c-2d229e245894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:01.315352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1269/2542] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:45:01.320041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaf3af-ea23-40f2-a22f-babe0d6b0b33 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:01.329750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaf3af-ea23-40f2-a22f-babe0d6b0b33 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:01.334260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55d4b7-6690-4fb6-b94a-6c406abecb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:01.334900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55d4b7-6690-4fb6-b94a-6c406abecb00 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.335815 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55d4b7-6690-4fb6-b94a-6c406abecb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.336096 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55d4b7-6690-4fb6-b94a-6c406abecb00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.336874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55d4b7-6690-4fb6-b94a-6c406abecb00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:45:01.337176 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55d4b7-6690-4fb6-b94a-6c406abecb00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:01.338772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55d4b7-6690-4fb6-b94a-6c406abecb00 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:01.349872 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1274/2543] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:45:01.353894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393d419-6a4e-4bd3-981c-2d229e245894 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:01.362766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393d419-6a4e-4bd3-981c-2d229e245894 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:01.367916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a1c37-9a56-425c-b2f8-0f87a83afac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:01.368582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a1c37-9a56-425c-b2f8-0f87a83afac6 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.368856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a1c37-9a56-425c-b2f8-0f87a83afac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.369123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a1c37-9a56-425c-b2f8-0f87a83afac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.369808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a1c37-9a56-425c-b2f8-0f87a83afac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:01.371654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a1c37-9a56-425c-b2f8-0f87a83afac6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:01.396366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1270/2544] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:45:01 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:45:01.400280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55d4b7-6690-4fb6-b94a-6c406abecb00 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:01.410263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55d4b7-6690-4fb6-b94a-6c406abecb00 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:01.464633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c160e8-f1f6-400e-9971-f07f86bc450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:01.465522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c160e8-f1f6-400e-9971-f07f86bc450f admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.465807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c160e8-f1f6-400e-9971-f07f86bc450f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.466112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c160e8-f1f6-400e-9971-f07f86bc450f admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.466789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c160e8-f1f6-400e-9971-f07f86bc450f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:01.468746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c160e8-f1f6-400e-9971-f07f86bc450f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:01.487655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1275/2545] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:45:01 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:45:01.492361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a1c37-9a56-425c-b2f8-0f87a83afac6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:01.502318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a1c37-9a56-425c-b2f8-0f87a83afac6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:01.506800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bf4db-7d1c-4eab-88a0-0acd3b8f8805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:01.508059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bf4db-7d1c-4eab-88a0-0acd3b8f8805 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.508332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bf4db-7d1c-4eab-88a0-0acd3b8f8805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.508630 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bf4db-7d1c-4eab-88a0-0acd3b8f8805 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.509395 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bf4db-7d1c-4eab-88a0-0acd3b8f8805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:01.511030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bf4db-7d1c-4eab-88a0-0acd3b8f8805 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:01.521220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1271/2546] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:45:01.525058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c160e8-f1f6-400e-9971-f07f86bc450f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:01.534778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c160e8-f1f6-400e-9971-f07f86bc450f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:01.539618 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87467bee-9274-436c-ae27-0b7aec337ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:01.540266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87467bee-9274-436c-ae27-0b7aec337ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.540583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87467bee-9274-436c-ae27-0b7aec337ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.540879 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87467bee-9274-436c-ae27-0b7aec337ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.541604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87467bee-9274-436c-ae27-0b7aec337ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:01.543181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87467bee-9274-436c-ae27-0b7aec337ea3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:01.552851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1276/2547] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:45:01.557236 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bf4db-7d1c-4eab-88a0-0acd3b8f8805 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:01.566806 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bf4db-7d1c-4eab-88a0-0acd3b8f8805 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:01.571870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c799157-d80f-4bbd-977a-9b8cd0caa496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:01.573267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c799157-d80f-4bbd-977a-9b8cd0caa496 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.573544 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c799157-d80f-4bbd-977a-9b8cd0caa496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.573812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c799157-d80f-4bbd-977a-9b8cd0caa496 admin admin] PATH_INFO: `/v3/projects/72eb261400104c0b9b2132c91f25845b/users/48a9098a2f7d4bff894abe78308107be/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.587887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c799157-d80f-4bbd-977a-9b8cd0caa496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72eb261400104c0b9b2132c91f25845b, user_id=48a9098a2f7d4bff894abe78308107be, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:01.591385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c799157-d80f-4bbd-977a-9b8cd0caa496 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:01.603862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1272/2548] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:45:01 2022] PUT /identity/v3/projects/72eb261400104c0b9b2132c91f25845b/users/48a9098a2f7d4bff894abe78308107be/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:45:01.609307 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ef7c7-9f77-4b72-9df8-2ac7ee3b6bd7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.609813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ef7c7-9f77-4b72-9df8-2ac7ee3b6bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.609908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ef7c7-9f77-4b72-9df8-2ac7ee3b6bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.628156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1b9ef7c7-9f77-4b72-9df8-2ac7ee3b6bd7 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:01.629397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1b9ef7c7-9f77-4b72-9df8-2ac7ee3b6bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:01.687048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1277/2549] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:45:01.697413 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c799157-d80f-4bbd-977a-9b8cd0caa496 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:01.699107 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7c799157-d80f-4bbd-977a-9b8cd0caa496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:01.754327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c799157-d80f-4bbd-977a-9b8cd0caa496 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:01.758189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756bb06-0063-44a5-af32-f81e4aeb55c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:01.758824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756bb06-0063-44a5-af32-f81e4aeb55c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:01.759103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756bb06-0063-44a5-af32-f81e4aeb55c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:01.759374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756bb06-0063-44a5-af32-f81e4aeb55c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:01.768567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756bb06-0063-44a5-af32-f81e4aeb55c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:01.770937 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756bb06-0063-44a5-af32-f81e4aeb55c9 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:01.781146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1273/2550] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:45:05.837361 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48529d-b6f0-4703-82d4-4bf931e86369 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:05.837953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48529d-b6f0-4703-82d4-4bf931e86369 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:05.837953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48529d-b6f0-4703-82d4-4bf931e86369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:05.865680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3e48529d-b6f0-4703-82d4-4bf931e86369 None None] MFA Rules not processed for user `48a9098a2f7d4bff894abe78308107be`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:05.868415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3e48529d-b6f0-4703-82d4-4bf931e86369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:05.954254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1278/2551] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:45:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:45:05.954767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756bb06-0063-44a5-af32-f81e4aeb55c9 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:05.965715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756bb06-0063-44a5-af32-f81e4aeb55c9 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:05.970915 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56948e2-bb61-45ce-93bb-12da31b98b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:05.971586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56948e2-bb61-45ce-93bb-12da31b98b79 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:05.971855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56948e2-bb61-45ce-93bb-12da31b98b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:05.972127 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56948e2-bb61-45ce-93bb-12da31b98b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:05.972881 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56948e2-bb61-45ce-93bb-12da31b98b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:05.974767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56948e2-bb61-45ce-93bb-12da31b98b79 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:06.007807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48529d-b6f0-4703-82d4-4bf931e86369 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:06.009721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1274/2552] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:45:05 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:45:06.019702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48529d-b6f0-4703-82d4-4bf931e86369 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:06.079971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b3d27-7ec9-4262-b429-1badf65100b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:06.080773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b3d27-7ec9-4262-b429-1badf65100b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:06.081127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b3d27-7ec9-4262-b429-1badf65100b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:06.081466 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b3d27-7ec9-4262-b429-1badf65100b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:06.082238 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b3d27-7ec9-4262-b429-1badf65100b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:06.084255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b3d27-7ec9-4262-b429-1badf65100b8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:06.109159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1279/2553] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:45:06 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:45:06.110451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56948e2-bb61-45ce-93bb-12da31b98b79 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:06.123861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56948e2-bb61-45ce-93bb-12da31b98b79 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:06.129314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c696-693c-498b-ab3b-22835f10d8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:06.130113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c696-693c-498b-ab3b-22835f10d8da admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:06.131042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c696-693c-498b-ab3b-22835f10d8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:06.131042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9c696-693c-498b-ab3b-22835f10d8da admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:06.131727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9c696-693c-498b-ab3b-22835f10d8da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:06.134063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9c696-693c-498b-ab3b-22835f10d8da admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:06.146966 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1275/2554] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:45:06.150454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b3d27-7ec9-4262-b429-1badf65100b8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:06.160780 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b3d27-7ec9-4262-b429-1badf65100b8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:06.165707 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863943-7672-4334-89bd-53aa48938b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:06.166595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863943-7672-4334-89bd-53aa48938b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:06.166869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863943-7672-4334-89bd-53aa48938b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:06.167136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863943-7672-4334-89bd-53aa48938b26 admin admin] PATH_INFO: `/v3/projects/dcf6edc7c4d445b1a55be6028e3dccbc/users/0b604e7e16514b8b8b5a1a1ae91cfc9f/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:06.183017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863943-7672-4334-89bd-53aa48938b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf6edc7c4d445b1a55be6028e3dccbc, user_id=0b604e7e16514b8b8b5a1a1ae91cfc9f, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:06.185762 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863943-7672-4334-89bd-53aa48938b26 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:06.201396 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1280/2555] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:45:06 2022] PUT /identity/v3/projects/dcf6edc7c4d445b1a55be6028e3dccbc/users/0b604e7e16514b8b8b5a1a1ae91cfc9f/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:45:06.208986 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c696-693c-498b-ab3b-22835f10d8da admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:06.241152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9c696-693c-498b-ab3b-22835f10d8da admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:06.315074 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b792b-ecb3-4f51-bfca-bec50b4689d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:06.315754 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b792b-ecb3-4f51-bfca-bec50b4689d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:06.316399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b792b-ecb3-4f51-bfca-bec50b4689d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:06.316854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b792b-ecb3-4f51-bfca-bec50b4689d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:06.317619 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b792b-ecb3-4f51-bfca-bec50b4689d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:06.319345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b792b-ecb3-4f51-bfca-bec50b4689d7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:06.330146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1276/2556] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:45:06.334318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863943-7672-4334-89bd-53aa48938b26 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:06.345163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863943-7672-4334-89bd-53aa48938b26 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:06.350478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1b377-6bd6-4785-bed1-1c6c9cba3557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:06.352027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1b377-6bd6-4785-bed1-1c6c9cba3557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:06.352443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1b377-6bd6-4785-bed1-1c6c9cba3557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:06.352822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1b377-6bd6-4785-bed1-1c6c9cba3557 admin admin] PATH_INFO: `/v3/projects/dcf6edc7c4d445b1a55be6028e3dccbc/users/0b604e7e16514b8b8b5a1a1ae91cfc9f/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:06.355041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1b377-6bd6-4785-bed1-1c6c9cba3557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf6edc7c4d445b1a55be6028e3dccbc, user_id=0b604e7e16514b8b8b5a1a1ae91cfc9f, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:06.357859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1b377-6bd6-4785-bed1-1c6c9cba3557 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:06.370155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1281/2557] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:45:06 2022] PUT /identity/v3/projects/dcf6edc7c4d445b1a55be6028e3dccbc/users/0b604e7e16514b8b8b5a1a1ae91cfc9f/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:45:12.618719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75fd34-c136-43d3-8961-380d7df04b1d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:12.619229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75fd34-c136-43d3-8961-380d7df04b1d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:12.619594 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75fd34-c136-43d3-8961-380d7df04b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:12.649706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bf75fd34-c136-43d3-8961-380d7df04b1d None None] MFA Rules not processed for user `0b604e7e16514b8b8b5a1a1ae91cfc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:12.651146 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bf75fd34-c136-43d3-8961-380d7df04b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:12.737955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1277/2558] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:45:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:45:12.753377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1b377-6bd6-4785-bed1-1c6c9cba3557 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:12.755542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-cfc1b377-6bd6-4785-bed1-1c6c9cba3557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:12.843440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1b377-6bd6-4785-bed1-1c6c9cba3557 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:12.847136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b310e9-15de-40af-8c42-4c333ee79f4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '612a02fb42af490abcba0e75ec8c759f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:12.847775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b310e9-15de-40af-8c42-4c333ee79f4d service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:12.848050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b310e9-15de-40af-8c42-4c333ee79f4d service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:12.848321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b310e9-15de-40af-8c42-4c333ee79f4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:12.907771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b310e9-15de-40af-8c42-4c333ee79f4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:12.910127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b310e9-15de-40af-8c42-4c333ee79f4d service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:12.921471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1282/2559] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:45:13.029629 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670a18-ca91-4020-8530-2a34ce87e0d6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:13.030001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670a18-ca91-4020-8530-2a34ce87e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:13.030354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5670a18-ca91-4020-8530-2a34ce87e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:13.052712 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a5670a18-ca91-4020-8530-2a34ce87e0d6 None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:13.054571 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a5670a18-ca91-4020-8530-2a34ce87e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:13.122259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1278/2560] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:45:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:45:13.141725 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b310e9-15de-40af-8c42-4c333ee79f4d service glance] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:13.143655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-28b310e9-15de-40af-8c42-4c333ee79f4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:13.230777 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b310e9-15de-40af-8c42-4c333ee79f4d service glance] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:13.238161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0afb28-32c8-4962-b6d7-2ba2d5dd2af2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:13.238839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0afb28-32c8-4962-b6d7-2ba2d5dd2af2 service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:13.239184 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0afb28-32c8-4962-b6d7-2ba2d5dd2af2 service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:13.239463 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0afb28-32c8-4962-b6d7-2ba2d5dd2af2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:13.249154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0afb28-32c8-4962-b6d7-2ba2d5dd2af2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:13.250821 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0afb28-32c8-4962-b6d7-2ba2d5dd2af2 service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:13.261383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1283/2561] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:45:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:45:22.623715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abba578-0e9e-44cc-a387-8b31e8ba60b4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:22.624210 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abba578-0e9e-44cc-a387-8b31e8ba60b4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:22.624333 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abba578-0e9e-44cc-a387-8b31e8ba60b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:22.645833 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3abba578-0e9e-44cc-a387-8b31e8ba60b4 None None] MFA Rules not processed for user `48a9098a2f7d4bff894abe78308107be`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:22.647567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3abba578-0e9e-44cc-a387-8b31e8ba60b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:22.655163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1279/2562] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:45:25.857965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8f71-f209-4ae4-b56a-e57dad65b734 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:25.858464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8f71-f209-4ae4-b56a-e57dad65b734 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:25.858604 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b8f71-f209-4ae4-b56a-e57dad65b734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:25.877931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-345b8f71-f209-4ae4-b56a-e57dad65b734 None None] MFA Rules not processed for user `96cb52955ccd402f91bb0c3c982ae6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:25.879119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-345b8f71-f209-4ae4-b56a-e57dad65b734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:25.939596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1284/2563] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:45:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:45:26.534183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba6d0b-b006-419b-aa27-02c909429294 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:26.534681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba6d0b-b006-419b-aa27-02c909429294 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:26.534783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba6d0b-b006-419b-aa27-02c909429294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:26.554020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-09ba6d0b-b006-419b-aa27-02c909429294 None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:26.555257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-09ba6d0b-b006-419b-aa27-02c909429294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:26.572793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1280/2564] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:45:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:45:26.577794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b8f71-f209-4ae4-b56a-e57dad65b734 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:26.597857 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b8f71-f209-4ae4-b56a-e57dad65b734 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:26.605526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23e4bd-3716-4cc0-9429-000690ae9b0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:26.607119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23e4bd-3716-4cc0-9429-000690ae9b0b service swift] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:26.608379 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23e4bd-3716-4cc0-9429-000690ae9b0b service swift] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:26.608882 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23e4bd-3716-4cc0-9429-000690ae9b0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:26.620908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23e4bd-3716-4cc0-9429-000690ae9b0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:26.625529 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23e4bd-3716-4cc0-9429-000690ae9b0b service swift] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:26.637592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1285/2565] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:45:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:45:27.971517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba6d0b-b006-419b-aa27-02c909429294 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:28.035547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba6d0b-b006-419b-aa27-02c909429294 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:28.039899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:28.040878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:28.041222 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:28.041708 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:28.043525 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:28.141973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:28.144878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:28.163221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1281/2566] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:45:29.516743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23e4bd-3716-4cc0-9429-000690ae9b0b service swift] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:29.518802 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-af23e4bd-3716-4cc0-9429-000690ae9b0b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:29.531182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23e4bd-3716-4cc0-9429-000690ae9b0b service swift] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:29.534846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058b959-4b00-43b4-ad79-9c9a82af9f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:29.535500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058b959-4b00-43b4-ad79-9c9a82af9f81 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:29.535871 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058b959-4b00-43b4-ad79-9c9a82af9f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:29.536050 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058b959-4b00-43b4-ad79-9c9a82af9f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:29.538648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3058b959-4b00-43b4-ad79-9c9a82af9f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:29.552619 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058b959-4b00-43b4-ad79-9c9a82af9f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:29.554718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058b959-4b00-43b4-ad79-9c9a82af9f81 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:29.566900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1286/2567] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:45:37.380008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:37.381623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:37.459747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc73916-a623-4a43-8f2c-319618c53b02 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:37.465399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:37.466433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:37.466776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:37.467116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] PATH_INFO: `/v3/users/92f4a8bb9b7c42b09b79fd5a56af9bcb` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:37.468633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f4a8bb9b7c42b09b79fd5a56af9bcb)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:37.470767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:37.525960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f4a8bb9b7c42b09b79fd5a56af9bcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.532953 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f4a8bb9b7c42b09b79fd5a56af9bcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.544094 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f4a8bb9b7c42b09b79fd5a56af9bcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.544840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f4a8bb9b7c42b09b79fd5a56af9bcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.553521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1857b3e9-1c8c-4431-b64d-4ba7fcc34007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f4a8bb9b7c42b09b79fd5a56af9bcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.562691 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1282/2568] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:45:37 2022] DELETE /identity/v3/users/92f4a8bb9b7c42b09b79fd5a56af9bcb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:45:37.732282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058b959-4b00-43b4-ad79-9c9a82af9f81 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:37.749212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058b959-4b00-43b4-ad79-9c9a82af9f81 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:37.831062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:37.831927 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:37.832234 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:37.832970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] PATH_INFO: `/v3/projects/4cc0a066776349848e07e28a79e43871` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:37.834804 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc0a066776349848e07e28a79e43871)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:37.837173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:37.907425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc0a066776349848e07e28a79e43871', 'request_id': 'req-ccacbce5-753c-403c-9e31-ad3f651237ca'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.915633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc0a066776349848e07e28a79e43871', 'request_id': 'req-ccacbce5-753c-403c-9e31-ad3f651237ca'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.925482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc0a066776349848e07e28a79e43871', 'request_id': 'req-ccacbce5-753c-403c-9e31-ad3f651237ca'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.937347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] The token cache is being invalidate because project 4cc0a066776349848e07e28a79e43871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:45:37.937763 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.938508 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:45:37.940215 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1287/2569] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:45:37 2022] DELETE /identity/v3/projects/4cc0a066776349848e07e28a79e43871 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:45:40.530226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a079e-a081-4746-b61c-e56020451a64 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:40.530713 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a079e-a081-4746-b61c-e56020451a64 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:40.530899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a079e-a081-4746-b61c-e56020451a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:40.549512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-018a079e-a081-4746-b61c-e56020451a64 None None] MFA Rules not processed for user `f182c5215d37423da1a00cbb98757957`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:45:40.550902 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-018a079e-a081-4746-b61c-e56020451a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:40.608776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1283/2570] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:45:41.873740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:41.875716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:41.972944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacbce5-753c-403c-9e31-ad3f651237ca admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:41.978196 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06b37b8f23946ebbb5083a877274ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:41.978872 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:41.979158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:41.979430 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:41.981265 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:41.993363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:41.994982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:42.005056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1288/2571] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:45:42.802557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a079e-a081-4746-b61c-e56020451a64 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:42.804067 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-018a079e-a081-4746-b61c-e56020451a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:42.859800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a079e-a081-4746-b61c-e56020451a64 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:42.863268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:42.863902 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:42.864182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:42.864507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:42.866403 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:42.876897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:42.878426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:42.887200 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1284/2572] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:45:42.897190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:42.899325 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:43.027522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e068c18-cc57-4d22-b11d-e761f8158ea3 service placement] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:43.035359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:43.036179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:43.037760 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:43.038054 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:43.041120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:43.115252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:43.116807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:43.125966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1289/2573] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:45:47.507519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:47.509297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:47.527212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bcf09-5bff-4f0a-b1da-9c705e2d72be service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:47.539666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63067076-2e38-4acc-bde2-d7e327049ebb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:47.540425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63067076-2e38-4acc-bde2-d7e327049ebb service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:47.540715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63067076-2e38-4acc-bde2-d7e327049ebb service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:47.541230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63067076-2e38-4acc-bde2-d7e327049ebb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:47.543503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-63067076-2e38-4acc-bde2-d7e327049ebb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:47.612218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63067076-2e38-4acc-bde2-d7e327049ebb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:47.613855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63067076-2e38-4acc-bde2-d7e327049ebb service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:47.623863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1285/2574] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:45:54.192191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:54.193700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:54.206591 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d55f89-7c48-494a-bd60-ded7775d57d5 service nova] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:54.211692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f51493-2082-47ec-b56a-f2bf8d8a9d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:54.212516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f51493-2082-47ec-b56a-f2bf8d8a9d68 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:54.212800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f51493-2082-47ec-b56a-f2bf8d8a9d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:54.213183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f51493-2082-47ec-b56a-f2bf8d8a9d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:54.215128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-73f51493-2082-47ec-b56a-f2bf8d8a9d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:54.276691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f51493-2082-47ec-b56a-f2bf8d8a9d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:54.278168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f51493-2082-47ec-b56a-f2bf8d8a9d68 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:54.287495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1290/2575] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:45:55.939187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63067076-2e38-4acc-bde2-d7e327049ebb service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:45:55.950993 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63067076-2e38-4acc-bde2-d7e327049ebb service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:45:55.956793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:45:55.957631 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:45:55.957848 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:45:55.958310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:45:55.960521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:45:55.977805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:45:55.980144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:45:55.996662 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1286/2576] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:45:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:01.283319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ae7e-163b-483b-ae5e-fd9a559659dc None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:01.283849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ae7e-163b-483b-ae5e-fd9a559659dc None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:01.283849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5ae7e-163b-483b-ae5e-fd9a559659dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:01.303901 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-48b5ae7e-163b-483b-ae5e-fd9a559659dc None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:01.305388 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-48b5ae7e-163b-483b-ae5e-fd9a559659dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:01.360120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1291/2577] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:46:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:01.382954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:01.384872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:01.457073 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6329222-5d86-4d6f-9b96-f902e674ad9e service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:01.463281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b90ab1-537e-4677-9ebd-8daaa9d0572e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:01.464051 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90ab1-537e-4677-9ebd-8daaa9d0572e service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:01.464332 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90ab1-537e-4677-9ebd-8daaa9d0572e service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:01.464710 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90ab1-537e-4677-9ebd-8daaa9d0572e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:01.473492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b90ab1-537e-4677-9ebd-8daaa9d0572e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:01.476697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b90ab1-537e-4677-9ebd-8daaa9d0572e service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:01.485191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1287/2578] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:46:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:46:15.583285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ad87-9a4f-4eab-bd64-65bd5698aa86 None None] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:15.583943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ad87-9a4f-4eab-bd64-65bd5698aa86 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:15.583943 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ad87-9a4f-4eab-bd64-65bd5698aa86 None None] PATH_INFO: `/` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:15.586337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1292/2579] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:46:15.592829 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047a9cd-ed56-4f0c-918d-a50069165e2e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:15.593313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047a9cd-ed56-4f0c-918d-a50069165e2e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:15.593420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047a9cd-ed56-4f0c-918d-a50069165e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:15.630702 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4047a9cd-ed56-4f0c-918d-a50069165e2e None None] MFA Rules not processed for user `904a4e5f54e642eda58c90930b5858f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:15.633195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4047a9cd-ed56-4f0c-918d-a50069165e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:15.641934 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1288/2580] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:15.653835 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2ad87-9a4f-4eab-bd64-65bd5698aa86 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:15.655525 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e7f2ad87-9a4f-4eab-bd64-65bd5698aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:15.716435 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2ad87-9a4f-4eab-bd64-65bd5698aa86 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:15.716854 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de434056-9d6b-4668-96c0-2d2d2d4dee66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '612a02fb42af490abcba0e75ec8c759f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:15.717495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434056-9d6b-4668-96c0-2d2d2d4dee66 service glance] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:15.717773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434056-9d6b-4668-96c0-2d2d2d4dee66 service glance] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:15.718045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434056-9d6b-4668-96c0-2d2d2d4dee66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:15.728086 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434056-9d6b-4668-96c0-2d2d2d4dee66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:15.729550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434056-9d6b-4668-96c0-2d2d2d4dee66 service glance] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:15.740744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1293/2581] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:15.807232 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536c99a-330f-4d5c-90b5-7e356175c193 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:15.807524 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536c99a-330f-4d5c-90b5-7e356175c193 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:15.807800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536c99a-330f-4d5c-90b5-7e356175c193 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:15.809652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1289/2582] 10.222.0.15 () {54 vars in 921 bytes} [Mon Feb 7 02:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 07 02:46:15.814385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e109bd-02c0-4d62-bb8f-d82d0201b24c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:15.814668 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e109bd-02c0-4d62-bb8f-d82d0201b24c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:15.814941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e109bd-02c0-4d62-bb8f-d82d0201b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:15.834831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-31e109bd-02c0-4d62-bb8f-d82d0201b24c None None] MFA Rules not processed for user `b3922641f7c846da98457824bec58652`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:15.836029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-31e109bd-02c0-4d62-bb8f-d82d0201b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:15.842649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1294/2583] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Feb 7 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:15.854307 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536c99a-330f-4d5c-90b5-7e356175c193 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:15.866592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536c99a-330f-4d5c-90b5-7e356175c193 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:15.869513 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568637c5-2848-4a15-8a1a-316b6608214c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:15.870152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568637c5-2848-4a15-8a1a-316b6608214c service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:15.870432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568637c5-2848-4a15-8a1a-316b6608214c service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:15.870731 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568637c5-2848-4a15-8a1a-316b6608214c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:15.878296 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568637c5-2848-4a15-8a1a-316b6608214c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:15.879718 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568637c5-2848-4a15-8a1a-316b6608214c service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:15.888106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1290/2584] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:16.477817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e109bd-02c0-4d62-bb8f-d82d0201b24c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:16.486491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e109bd-02c0-4d62-bb8f-d82d0201b24c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:16.490854 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d689a4d-c410-42e6-8473-5a075063d8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:16.491608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689a4d-c410-42e6-8473-5a075063d8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:16.491891 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689a4d-c410-42e6-8473-5a075063d8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:16.492164 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689a4d-c410-42e6-8473-5a075063d8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:16.493952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8d689a4d-c410-42e6-8473-5a075063d8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:16.503218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d689a4d-c410-42e6-8473-5a075063d8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:16.504712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d689a4d-c410-42e6-8473-5a075063d8d5 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:16.513356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1295/2585] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:16.666843 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568637c5-2848-4a15-8a1a-316b6608214c service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:16.689341 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568637c5-2848-4a15-8a1a-316b6608214c service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:16.696510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82493b6-76f0-476b-8463-600b594d7272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:16.697732 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82493b6-76f0-476b-8463-600b594d7272 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:16.698081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82493b6-76f0-476b-8463-600b594d7272 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:16.698416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82493b6-76f0-476b-8463-600b594d7272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:16.700498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f82493b6-76f0-476b-8463-600b594d7272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:16.727532 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82493b6-76f0-476b-8463-600b594d7272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:16.729859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82493b6-76f0-476b-8463-600b594d7272 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:16.748815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1291/2586] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:17.601273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbef57-2e31-4d65-a5ac-179c67ed3b67 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:17.601768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbef57-2e31-4d65-a5ac-179c67ed3b67 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:17.601888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbef57-2e31-4d65-a5ac-179c67ed3b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:17.621686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-8bfbef57-2e31-4d65-a5ac-179c67ed3b67 None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:17.622900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-8bfbef57-2e31-4d65-a5ac-179c67ed3b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:17.631654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1296/2587] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Feb 7 02:46:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:17.643643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82493b6-76f0-476b-8463-600b594d7272 service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:17.654947 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82493b6-76f0-476b-8463-600b594d7272 service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:17.659999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77591bb8-ee48-4046-8bff-0967cfb1e689 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:17.660695 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77591bb8-ee48-4046-8bff-0967cfb1e689 service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:17.660976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77591bb8-ee48-4046-8bff-0967cfb1e689 service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:17.661249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77591bb8-ee48-4046-8bff-0967cfb1e689 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:17.669678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77591bb8-ee48-4046-8bff-0967cfb1e689 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:17.671242 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77591bb8-ee48-4046-8bff-0967cfb1e689 service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:17.680371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1292/2588] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 02:46:34.380567 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b8a1-d99d-47d7-ad0c-475526180623 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:34.381111 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b8a1-d99d-47d7-ad0c-475526180623 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:34.381362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2b8a1-d99d-47d7-ad0c-475526180623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:34.400181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-71c2b8a1-d99d-47d7-ad0c-475526180623 None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:34.401660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-71c2b8a1-d99d-47d7-ad0c-475526180623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:34.409195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1297/2589] 10.222.0.15 () {58 vars in 967 bytes} [Mon Feb 7 02:46:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:34.422425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77591bb8-ee48-4046-8bff-0967cfb1e689 service swift] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:34.436123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77591bb8-ee48-4046-8bff-0967cfb1e689 service swift] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:34.441757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e813d3-d002-4237-ab74-284737d598eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:34.442410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e813d3-d002-4237-ab74-284737d598eb service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:34.442693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e813d3-d002-4237-ab74-284737d598eb service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:34.442971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e813d3-d002-4237-ab74-284737d598eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:34.452313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e813d3-d002-4237-ab74-284737d598eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:34.453929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e813d3-d002-4237-ab74-284737d598eb service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:34.462842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1293/2590] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:46:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 07 02:46:39.796789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2b8a1-d99d-47d7-ad0c-475526180623 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:39.818141 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2b8a1-d99d-47d7-ad0c-475526180623 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:39.826076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:39.827190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:39.827799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:39.828260 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:39.836210 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:39.855159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:39.859765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:39.890248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1298/2591] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:45.674477 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e813d3-d002-4237-ab74-284737d598eb service swift] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:45.684244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e813d3-d002-4237-ab74-284737d598eb service swift] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:45.687826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19500c-c76b-47a5-b013-3177646f2998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:45.688484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19500c-c76b-47a5-b013-3177646f2998 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:45.688767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19500c-c76b-47a5-b013-3177646f2998 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:45.689041 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19500c-c76b-47a5-b013-3177646f2998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:45.690752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2a19500c-c76b-47a5-b013-3177646f2998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:45.752440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19500c-c76b-47a5-b013-3177646f2998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:45.753855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19500c-c76b-47a5-b013-3177646f2998 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:45.765507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1294/2592] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:49.100051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:49.101759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:49.116832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f00a6-1c48-4a27-9c42-40953fae7e01 service nova] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:49.122284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:49.123091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.123377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.123702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] PATH_INFO: `/v3/users/96cb52955ccd402f91bb0c3c982ae6e6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.124965 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96cb52955ccd402f91bb0c3c982ae6e6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:49.126996 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:49.173068 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96cb52955ccd402f91bb0c3c982ae6e6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.180304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96cb52955ccd402f91bb0c3c982ae6e6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.187233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96cb52955ccd402f91bb0c3c982ae6e6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.199411 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96cb52955ccd402f91bb0c3c982ae6e6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.199994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-45c21df2-4952-43c4-a86a-da1ad70a0ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96cb52955ccd402f91bb0c3c982ae6e6'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.205626 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1299/2593] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:46:49 2022] DELETE /identity/v3/users/96cb52955ccd402f91bb0c3c982ae6e6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:49.371914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19500c-c76b-47a5-b013-3177646f2998 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:49.386649 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19500c-c76b-47a5-b013-3177646f2998 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:49.441814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:49.442653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.442929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.443196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] PATH_INFO: `/v3/projects/a49aa1fab0e34cf8b10b7d216d642828` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.444385 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a49aa1fab0e34cf8b10b7d216d642828)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:49.446295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:49.489461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49aa1fab0e34cf8b10b7d216d642828', 'request_id': 'req-f59bd677-a232-4296-a798-1921c539684b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.495844 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49aa1fab0e34cf8b10b7d216d642828', 'request_id': 'req-f59bd677-a232-4296-a798-1921c539684b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.500992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49aa1fab0e34cf8b10b7d216d642828', 'request_id': 'req-f59bd677-a232-4296-a798-1921c539684b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.512052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] The token cache is being invalidate because project a49aa1fab0e34cf8b10b7d216d642828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:46:49.512329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.513027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f59bd677-a232-4296-a798-1921c539684b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:49.514579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1295/2594] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:46:49 2022] DELETE /identity/v3/projects/a49aa1fab0e34cf8b10b7d216d642828 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:49.520218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee17b1-f9b1-40d0-b1a3-21ce828d709d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.520551 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee17b1-f9b1-40d0-b1a3-21ce828d709d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.520827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee17b1-f9b1-40d0-b1a3-21ce828d709d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.538317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a8ee17b1-f9b1-40d0-b1a3-21ce828d709d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:49.540037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a8ee17b1-f9b1-40d0-b1a3-21ce828d709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:49.594935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1300/2595] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:49.603348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfb5fb-73df-4f81-b371-0b57a52eca6c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.603635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfb5fb-73df-4f81-b371-0b57a52eca6c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.603942 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfb5fb-73df-4f81-b371-0b57a52eca6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.622243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-cddfb5fb-73df-4f81-b371-0b57a52eca6c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:49.623431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cddfb5fb-73df-4f81-b371-0b57a52eca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:49.631402 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1296/2596] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:46:49.635548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee17b1-f9b1-40d0-b1a3-21ce828d709d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:49.645060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee17b1-f9b1-40d0-b1a3-21ce828d709d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:49.650179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51857c-cdf4-4496-996d-a4f7883808f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:49.650824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51857c-cdf4-4496-996d-a4f7883808f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.651100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51857c-cdf4-4496-996d-a4f7883808f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.651371 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51857c-cdf4-4496-996d-a4f7883808f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.652094 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51857c-cdf4-4496-996d-a4f7883808f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:46:49.652429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51857c-cdf4-4496-996d-a4f7883808f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:49.654033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51857c-cdf4-4496-996d-a4f7883808f0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:49.665738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1301/2597] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:46:49.669828 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfb5fb-73df-4f81-b371-0b57a52eca6c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:49.679156 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfb5fb-73df-4f81-b371-0b57a52eca6c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:49.683877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e12fe-2d6e-487c-8190-81f3332b5d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:49.684580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e12fe-2d6e-487c-8190-81f3332b5d57 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.684880 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e12fe-2d6e-487c-8190-81f3332b5d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.685155 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e12fe-2d6e-487c-8190-81f3332b5d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.685856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e12fe-2d6e-487c-8190-81f3332b5d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:49.687740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e12fe-2d6e-487c-8190-81f3332b5d57 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:49.712557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1297/2598] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:46:49 2022] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:46:49.716621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51857c-cdf4-4496-996d-a4f7883808f0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:49.726200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51857c-cdf4-4496-996d-a4f7883808f0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:49.779548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32645c75-93d2-42f9-82e9-1de5262aaef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:49.780120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32645c75-93d2-42f9-82e9-1de5262aaef4 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.780426 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32645c75-93d2-42f9-82e9-1de5262aaef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.780698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32645c75-93d2-42f9-82e9-1de5262aaef4 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.781395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32645c75-93d2-42f9-82e9-1de5262aaef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:49.783278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32645c75-93d2-42f9-82e9-1de5262aaef4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:49.803230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1302/2599] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:46:49 2022] POST /identity/v3/users => generated 302 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:46:49.807097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e12fe-2d6e-487c-8190-81f3332b5d57 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:49.817122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e12fe-2d6e-487c-8190-81f3332b5d57 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:49.823006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff545d-0ffd-473e-9a20-44bb990f2419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:49.823655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff545d-0ffd-473e-9a20-44bb990f2419 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.823935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff545d-0ffd-473e-9a20-44bb990f2419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.824214 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff545d-0ffd-473e-9a20-44bb990f2419 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.825012 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff545d-0ffd-473e-9a20-44bb990f2419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:49.826621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff545d-0ffd-473e-9a20-44bb990f2419 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:49.836864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1298/2600] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:46:49.840911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32645c75-93d2-42f9-82e9-1de5262aaef4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:49.850456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32645c75-93d2-42f9-82e9-1de5262aaef4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:49.855272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c62de-834d-42fd-aff7-01a09073e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:49.855941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c62de-834d-42fd-aff7-01a09073e394 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.856220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c62de-834d-42fd-aff7-01a09073e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.856557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c62de-834d-42fd-aff7-01a09073e394 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.857339 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c62de-834d-42fd-aff7-01a09073e394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:49.858916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c62de-834d-42fd-aff7-01a09073e394 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:49.869246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1303/2601] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:46:49.872999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff545d-0ffd-473e-9a20-44bb990f2419 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:49.883229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff545d-0ffd-473e-9a20-44bb990f2419 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:49.887798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c4e83-d165-43e2-a4e9-5b9bf5d06fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:49.888751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c4e83-d165-43e2-a4e9-5b9bf5d06fee admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.889064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c4e83-d165-43e2-a4e9-5b9bf5d06fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.889507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c4e83-d165-43e2-a4e9-5b9bf5d06fee admin admin] PATH_INFO: `/v3/projects/e9be6b79edf74789ab890651dae39bde/users/ab2decb8e4f245a9ac1977958c201cb2/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.903643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c4e83-d165-43e2-a4e9-5b9bf5d06fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9be6b79edf74789ab890651dae39bde, user_id=ab2decb8e4f245a9ac1977958c201cb2, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:49.906257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c4e83-d165-43e2-a4e9-5b9bf5d06fee admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:49.918139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1299/2602] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:46:49 2022] PUT /identity/v3/projects/e9be6b79edf74789ab890651dae39bde/users/ab2decb8e4f245a9ac1977958c201cb2/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:49.928004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0f14f-b04f-44e1-b190-f15dda00782d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:49.928315 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0f14f-b04f-44e1-b190-f15dda00782d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:49.928640 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0f14f-b04f-44e1-b190-f15dda00782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:49.955286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-38f0f14f-b04f-44e1-b190-f15dda00782d None None] MFA Rules not processed for user `ab2decb8e4f245a9ac1977958c201cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:49.956576 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-38f0f14f-b04f-44e1-b190-f15dda00782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:50.017623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1304/2603] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:46:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:50.022035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c4e83-d165-43e2-a4e9-5b9bf5d06fee admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:50.080913 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c4e83-d165-43e2-a4e9-5b9bf5d06fee admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:50.085517 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd8f9a-c809-4159-9206-a968de744052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:50.086163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd8f9a-c809-4159-9206-a968de744052 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.086440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd8f9a-c809-4159-9206-a968de744052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.086711 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd8f9a-c809-4159-9206-a968de744052 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.087400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd8f9a-c809-4159-9206-a968de744052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:50.089320 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd8f9a-c809-4159-9206-a968de744052 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:50.114276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1300/2604] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:46:50 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:46:50.118919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0f14f-b04f-44e1-b190-f15dda00782d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:50.129256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0f14f-b04f-44e1-b190-f15dda00782d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:50.183636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54e7d-75ea-4502-8afa-23ff1782c711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:50.184316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54e7d-75ea-4502-8afa-23ff1782c711 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.184636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54e7d-75ea-4502-8afa-23ff1782c711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.184913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54e7d-75ea-4502-8afa-23ff1782c711 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.185621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e54e7d-75ea-4502-8afa-23ff1782c711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:50.187578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e54e7d-75ea-4502-8afa-23ff1782c711 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:50.207758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1305/2605] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:46:50 2022] POST /identity/v3/users => generated 309 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:46:50.211811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd8f9a-c809-4159-9206-a968de744052 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:50.221903 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd8f9a-c809-4159-9206-a968de744052 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:50.226941 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383990f-d1a3-4192-8f33-5785520c1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:50.227579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383990f-d1a3-4192-8f33-5785520c1dec admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.227857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383990f-d1a3-4192-8f33-5785520c1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.228128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383990f-d1a3-4192-8f33-5785520c1dec admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.228894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383990f-d1a3-4192-8f33-5785520c1dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:50.230491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383990f-d1a3-4192-8f33-5785520c1dec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:50.240727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1301/2606] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:46:50.245695 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54e7d-75ea-4502-8afa-23ff1782c711 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:50.259902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54e7d-75ea-4502-8afa-23ff1782c711 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:50.264827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b036b-80d9-47d2-8f1d-5a68ed273b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:50.265720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b036b-80d9-47d2-8f1d-5a68ed273b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.266003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b036b-80d9-47d2-8f1d-5a68ed273b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.266273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b036b-80d9-47d2-8f1d-5a68ed273b43 admin admin] PATH_INFO: `/v3/projects/a2fa40cf3bba431f9c0e6547ea6f42c6/users/f30ec9b477dc4e85be67828943db220d/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.281428 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b036b-80d9-47d2-8f1d-5a68ed273b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fa40cf3bba431f9c0e6547ea6f42c6, user_id=f30ec9b477dc4e85be67828943db220d, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:50.284074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b036b-80d9-47d2-8f1d-5a68ed273b43 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:50.296719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1306/2607] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:46:50 2022] PUT /identity/v3/projects/a2fa40cf3bba431f9c0e6547ea6f42c6/users/f30ec9b477dc4e85be67828943db220d/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:50.300680 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383990f-d1a3-4192-8f33-5785520c1dec admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:50.311060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383990f-d1a3-4192-8f33-5785520c1dec admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:50.364988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0e496-eb25-4a91-a16d-9d91622d1606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:50.365574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0e496-eb25-4a91-a16d-9d91622d1606 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.365856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0e496-eb25-4a91-a16d-9d91622d1606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.366132 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0e496-eb25-4a91-a16d-9d91622d1606 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.366900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0e496-eb25-4a91-a16d-9d91622d1606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:50.369134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0e496-eb25-4a91-a16d-9d91622d1606 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:50.378596 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1302/2608] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:46:50.382684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b036b-80d9-47d2-8f1d-5a68ed273b43 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:50.392669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b036b-80d9-47d2-8f1d-5a68ed273b43 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:50.397275 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ad1ec-0204-441b-9d1e-590438b24059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:50.398662 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad1ec-0204-441b-9d1e-590438b24059 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.398985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad1ec-0204-441b-9d1e-590438b24059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.399213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ad1ec-0204-441b-9d1e-590438b24059 admin admin] PATH_INFO: `/v3/projects/a2fa40cf3bba431f9c0e6547ea6f42c6/users/f30ec9b477dc4e85be67828943db220d/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.401278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ad1ec-0204-441b-9d1e-590438b24059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fa40cf3bba431f9c0e6547ea6f42c6, user_id=f30ec9b477dc4e85be67828943db220d, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:50.403886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ad1ec-0204-441b-9d1e-590438b24059 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:50.414505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1307/2609] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:46:50 2022] PUT /identity/v3/projects/a2fa40cf3bba431f9c0e6547ea6f42c6/users/f30ec9b477dc4e85be67828943db220d/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:50.425306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1e51-5208-4b7c-b32a-2a9df14328b1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.425671 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1e51-5208-4b7c-b32a-2a9df14328b1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.425956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1e51-5208-4b7c-b32a-2a9df14328b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.451339 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5e1d1e51-5208-4b7c-b32a-2a9df14328b1 None None] MFA Rules not processed for user `f30ec9b477dc4e85be67828943db220d`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:50.452570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5e1d1e51-5208-4b7c-b32a-2a9df14328b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:50.516133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1303/2610] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:46:50.525982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ad1ec-0204-441b-9d1e-590438b24059 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:50.527697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6a1ad1ec-0204-441b-9d1e-590438b24059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:50.587977 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ad1ec-0204-441b-9d1e-590438b24059 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:50.591641 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9743c-3c0b-4686-ba46-b69b07a04c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:50.592273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9743c-3c0b-4686-ba46-b69b07a04c5b service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.592582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9743c-3c0b-4686-ba46-b69b07a04c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.592855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9743c-3c0b-4686-ba46-b69b07a04c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.602121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9743c-3c0b-4686-ba46-b69b07a04c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:50.603552 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9743c-3c0b-4686-ba46-b69b07a04c5b service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:50.612749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1308/2611] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:50.740808 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1e51-5208-4b7c-b32a-2a9df14328b1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:50.799685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1e51-5208-4b7c-b32a-2a9df14328b1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:50.804122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:50.805001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.805280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.805565 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] PATH_INFO: `/v3/users/ab2decb8e4f245a9ac1977958c201cb2` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.806738 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2decb8e4f245a9ac1977958c201cb2)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:50.808664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:50.853351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2decb8e4f245a9ac1977958c201cb2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:50.859820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2decb8e4f245a9ac1977958c201cb2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:50.871197 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2decb8e4f245a9ac1977958c201cb2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:50.871770 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2decb8e4f245a9ac1977958c201cb2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:50.878365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2decb8e4f245a9ac1977958c201cb2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:50.884575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1304/2612] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:46:50 2022] DELETE /identity/v3/users/ab2decb8e4f245a9ac1977958c201cb2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:50.889105 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e611-e198-4529-b0b8-6210e8e4c6a7 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:50.889387 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e611-e198-4529-b0b8-6210e8e4c6a7 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:50.889660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e611-e198-4529-b0b8-6210e8e4c6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:50.907404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-1954e611-e198-4529-b0b8-6210e8e4c6a7 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:50.908631 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1954e611-e198-4529-b0b8-6210e8e4c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:50.971478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1309/2613] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:50.981019 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:50.982387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:51.038314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53164446-3bf1-421a-9105-730fc31ad447 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:51.041896 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ecdc3-587c-4e62-8894-ed962adbe034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:51.042522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ecdc3-587c-4e62-8894-ed962adbe034 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:51.042799 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ecdc3-587c-4e62-8894-ed962adbe034 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:51.043071 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ecdc3-587c-4e62-8894-ed962adbe034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:51.051899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ecdc3-587c-4e62-8894-ed962adbe034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:51.053331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ecdc3-587c-4e62-8894-ed962adbe034 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:51.062590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1305/2614] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:51.320110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e611-e198-4529-b0b8-6210e8e4c6a7 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:51.321873 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1954e611-e198-4529-b0b8-6210e8e4c6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:51.333583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954e611-e198-4529-b0b8-6210e8e4c6a7 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:51.338766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:51.339615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:51.339894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:51.340167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] PATH_INFO: `/v3/projects/e9be6b79edf74789ab890651dae39bde` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:51.341389 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9be6b79edf74789ab890651dae39bde)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:51.343299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:51.387664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9be6b79edf74789ab890651dae39bde', 'request_id': 'req-efd92a01-1f83-45df-87fb-94a2db3a2188'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.393578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9be6b79edf74789ab890651dae39bde', 'request_id': 'req-efd92a01-1f83-45df-87fb-94a2db3a2188'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.400874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9be6b79edf74789ab890651dae39bde', 'request_id': 'req-efd92a01-1f83-45df-87fb-94a2db3a2188'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.410537 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] The token cache is being invalidate because project e9be6b79edf74789ab890651dae39bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:46:51.410824 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.411439 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.412976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1310/2615] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:46:51 2022] DELETE /identity/v3/projects/e9be6b79edf74789ab890651dae39bde => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:51.417464 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ecdc3-587c-4e62-8894-ed962adbe034 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:51.426924 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ecdc3-587c-4e62-8894-ed962adbe034 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:51.481482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:51.482348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:51.482627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:51.482908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] PATH_INFO: `/v3/users/f30ec9b477dc4e85be67828943db220d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:51.484109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30ec9b477dc4e85be67828943db220d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:51.486091 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:51.531099 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30ec9b477dc4e85be67828943db220d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.537553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30ec9b477dc4e85be67828943db220d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.548843 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30ec9b477dc4e85be67828943db220d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.549501 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30ec9b477dc4e85be67828943db220d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.556097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-314493fe-2a4f-4f90-bdf6-81b98ce594e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30ec9b477dc4e85be67828943db220d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.561805 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1306/2616] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:46:51 2022] DELETE /identity/v3/users/f30ec9b477dc4e85be67828943db220d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:51.825053 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:51.826473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:51.841481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd92a01-1f83-45df-87fb-94a2db3a2188 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:51.897007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:51.897859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:51.898677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:51.898947 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] PATH_INFO: `/v3/projects/a2fa40cf3bba431f9c0e6547ea6f42c6` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:51.900165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fa40cf3bba431f9c0e6547ea6f42c6)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:51.902125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:51.949712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fa40cf3bba431f9c0e6547ea6f42c6', 'request_id': 'req-1692f78d-4860-4683-9f0e-85bec8cef84a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.955724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fa40cf3bba431f9c0e6547ea6f42c6', 'request_id': 'req-1692f78d-4860-4683-9f0e-85bec8cef84a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.963157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fa40cf3bba431f9c0e6547ea6f42c6', 'request_id': 'req-1692f78d-4860-4683-9f0e-85bec8cef84a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.972891 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] The token cache is being invalidate because project a2fa40cf3bba431f9c0e6547ea6f42c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:46:51.973172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.973773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1692f78d-4860-4683-9f0e-85bec8cef84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:46:51.975273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1311/2617] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:46:51 2022] DELETE /identity/v3/projects/a2fa40cf3bba431f9c0e6547ea6f42c6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:51.981779 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7e508-af10-4b16-bc1b-a91e03a3af9f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:51.982064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7e508-af10-4b16-bc1b-a91e03a3af9f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:51.982336 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7e508-af10-4b16-bc1b-a91e03a3af9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.000792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-71a7e508-af10-4b16-bc1b-a91e03a3af9f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:52.002064 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-71a7e508-af10-4b16-bc1b-a91e03a3af9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:52.057444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1307/2618] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:52.065209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fabbf-49be-4757-b3ae-587a10a92c7b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.065494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fabbf-49be-4757-b3ae-587a10a92c7b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.065766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fabbf-49be-4757-b3ae-587a10a92c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.083626 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-dd1fabbf-49be-4757-b3ae-587a10a92c7b None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:52.084834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dd1fabbf-49be-4757-b3ae-587a10a92c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:52.093033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1312/2619] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:52.097131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7e508-af10-4b16-bc1b-a91e03a3af9f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.107297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7e508-af10-4b16-bc1b-a91e03a3af9f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.111816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa1ab1-4829-40aa-96d4-79e379f77cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.112500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa1ab1-4829-40aa-96d4-79e379f77cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.112782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa1ab1-4829-40aa-96d4-79e379f77cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.113055 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa1ab1-4829-40aa-96d4-79e379f77cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.113782 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa1ab1-4829-40aa-96d4-79e379f77cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:46:52.114085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa1ab1-4829-40aa-96d4-79e379f77cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.115659 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa1ab1-4829-40aa-96d4-79e379f77cfe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.126717 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1308/2620] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:46:52.130750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fabbf-49be-4757-b3ae-587a10a92c7b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.139569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fabbf-49be-4757-b3ae-587a10a92c7b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.144115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b750fbc-f285-44a8-be88-9a805008b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.144774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b750fbc-f285-44a8-be88-9a805008b5af admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.145051 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b750fbc-f285-44a8-be88-9a805008b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.145324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b750fbc-f285-44a8-be88-9a805008b5af admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.146012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b750fbc-f285-44a8-be88-9a805008b5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.147989 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b750fbc-f285-44a8-be88-9a805008b5af admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.173056 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1313/2621] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:46:52 2022] POST /identity/v3/projects => generated 353 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:46:52.176446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa1ab1-4829-40aa-96d4-79e379f77cfe admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.186186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa1ab1-4829-40aa-96d4-79e379f77cfe admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.246521 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11714d-6981-4621-a2c1-2ea1f34c8baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.247103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11714d-6981-4621-a2c1-2ea1f34c8baa admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.247383 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11714d-6981-4621-a2c1-2ea1f34c8baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.247657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11714d-6981-4621-a2c1-2ea1f34c8baa admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.248397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11714d-6981-4621-a2c1-2ea1f34c8baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.250302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11714d-6981-4621-a2c1-2ea1f34c8baa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.269902 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1309/2622] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:46:52 2022] POST /identity/v3/users => generated 277 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:46:52.274846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b750fbc-f285-44a8-be88-9a805008b5af admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.284846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b750fbc-f285-44a8-be88-9a805008b5af admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.289602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541ba4-707b-4799-915b-373939e2cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.290243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541ba4-707b-4799-915b-373939e2cf03 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.290523 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541ba4-707b-4799-915b-373939e2cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.290790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541ba4-707b-4799-915b-373939e2cf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.291509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54541ba4-707b-4799-915b-373939e2cf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.293153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54541ba4-707b-4799-915b-373939e2cf03 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.304235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1314/2623] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:46:52.308227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11714d-6981-4621-a2c1-2ea1f34c8baa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.317923 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11714d-6981-4621-a2c1-2ea1f34c8baa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.323327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c774-9d7c-4382-a1d3-abf03d9ee5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.323967 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c774-9d7c-4382-a1d3-abf03d9ee5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.324249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c774-9d7c-4382-a1d3-abf03d9ee5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.324557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c774-9d7c-4382-a1d3-abf03d9ee5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.325286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6c774-9d7c-4382-a1d3-abf03d9ee5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.326861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6c774-9d7c-4382-a1d3-abf03d9ee5f3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.337082 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1310/2624] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:46:52.340886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541ba4-707b-4799-915b-373939e2cf03 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.350617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541ba4-707b-4799-915b-373939e2cf03 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.355320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc699-641a-4637-beb1-9a4cb79cc3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.356177 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc699-641a-4637-beb1-9a4cb79cc3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.356489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc699-641a-4637-beb1-9a4cb79cc3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.356762 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bc699-641a-4637-beb1-9a4cb79cc3bd admin admin] PATH_INFO: `/v3/projects/28e91b7a855041bd84a77f48a893fa8e/users/99cba1f76e9f4984a6e9a305f0c8485b/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.370706 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bc699-641a-4637-beb1-9a4cb79cc3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e91b7a855041bd84a77f48a893fa8e, user_id=99cba1f76e9f4984a6e9a305f0c8485b, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.373382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bc699-641a-4637-beb1-9a4cb79cc3bd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.386313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1315/2625] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:46:52 2022] PUT /identity/v3/projects/28e91b7a855041bd84a77f48a893fa8e/users/99cba1f76e9f4984a6e9a305f0c8485b/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:52.396643 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b31998-9361-427d-b064-06dd1cae616e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.396933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b31998-9361-427d-b064-06dd1cae616e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.397227 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b31998-9361-427d-b064-06dd1cae616e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.423189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-94b31998-9361-427d-b064-06dd1cae616e None None] MFA Rules not processed for user `99cba1f76e9f4984a6e9a305f0c8485b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:52.424412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-94b31998-9361-427d-b064-06dd1cae616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:52.485122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1311/2626] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:52.489475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc699-641a-4637-beb1-9a4cb79cc3bd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.547926 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bc699-641a-4637-beb1-9a4cb79cc3bd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.552595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22337192-b78d-43d4-a95a-4f78beb3df2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.553241 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22337192-b78d-43d4-a95a-4f78beb3df2b admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.553520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22337192-b78d-43d4-a95a-4f78beb3df2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.553795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22337192-b78d-43d4-a95a-4f78beb3df2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.554496 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22337192-b78d-43d4-a95a-4f78beb3df2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.556404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22337192-b78d-43d4-a95a-4f78beb3df2b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.581252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1316/2627] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:46:52 2022] POST /identity/v3/projects => generated 357 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:46:52.584493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b31998-9361-427d-b064-06dd1cae616e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.595655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b31998-9361-427d-b064-06dd1cae616e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.650166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35afa2-de13-4234-b646-25c990c01e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.650939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35afa2-de13-4234-b646-25c990c01e2d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.651219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35afa2-de13-4234-b646-25c990c01e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.651491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35afa2-de13-4234-b646-25c990c01e2d admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.652192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35afa2-de13-4234-b646-25c990c01e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.654161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35afa2-de13-4234-b646-25c990c01e2d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.674120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1312/2628] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:46:52 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:46:52.678153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22337192-b78d-43d4-a95a-4f78beb3df2b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.688332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22337192-b78d-43d4-a95a-4f78beb3df2b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.692958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202abe-173a-44c5-a3f6-d91cc243ffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.693606 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202abe-173a-44c5-a3f6-d91cc243ffd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.693883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202abe-173a-44c5-a3f6-d91cc243ffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.694156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e202abe-173a-44c5-a3f6-d91cc243ffd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.694874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e202abe-173a-44c5-a3f6-d91cc243ffd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.696781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e202abe-173a-44c5-a3f6-d91cc243ffd1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.706944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1317/2629] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:46:52.711421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35afa2-de13-4234-b646-25c990c01e2d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.721118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35afa2-de13-4234-b646-25c990c01e2d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.725654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ea437-bb05-4d00-a9a5-a2fb2f76ea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.727103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea437-bb05-4d00-a9a5-a2fb2f76ea62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.727378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea437-bb05-4d00-a9a5-a2fb2f76ea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.727648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ea437-bb05-4d00-a9a5-a2fb2f76ea62 admin admin] PATH_INFO: `/v3/projects/bffa3a4ea11346d594eb1d24d945a257/users/c71667743d2c4a10a86c6f48c60edc67/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.741814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ea437-bb05-4d00-a9a5-a2fb2f76ea62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffa3a4ea11346d594eb1d24d945a257, user_id=c71667743d2c4a10a86c6f48c60edc67, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.744451 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ea437-bb05-4d00-a9a5-a2fb2f76ea62 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.756663 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1313/2630] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:46:52 2022] PUT /identity/v3/projects/bffa3a4ea11346d594eb1d24d945a257/users/c71667743d2c4a10a86c6f48c60edc67/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:52.760453 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202abe-173a-44c5-a3f6-d91cc243ffd1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.770142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e202abe-173a-44c5-a3f6-d91cc243ffd1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.824594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c5e47-6532-457d-9728-8577cd4c61de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.825191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5e47-6532-457d-9728-8577cd4c61de admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.825524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5e47-6532-457d-9728-8577cd4c61de admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.825806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5e47-6532-457d-9728-8577cd4c61de admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.826536 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c5e47-6532-457d-9728-8577cd4c61de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.828246 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c5e47-6532-457d-9728-8577cd4c61de admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.838372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1318/2631] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:46:52.842649 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ea437-bb05-4d00-a9a5-a2fb2f76ea62 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.853095 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ea437-bb05-4d00-a9a5-a2fb2f76ea62 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:52.857614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714167-3e76-4471-9976-01e6708c1285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:52.858470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714167-3e76-4471-9976-01e6708c1285 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.858741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714167-3e76-4471-9976-01e6708c1285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.859006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714167-3e76-4471-9976-01e6708c1285 admin admin] PATH_INFO: `/v3/projects/bffa3a4ea11346d594eb1d24d945a257/users/c71667743d2c4a10a86c6f48c60edc67/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.860989 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0714167-3e76-4471-9976-01e6708c1285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffa3a4ea11346d594eb1d24d945a257, user_id=c71667743d2c4a10a86c6f48c60edc67, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:52.863573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0714167-3e76-4471-9976-01e6708c1285 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:52.873893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1314/2632] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:46:52 2022] PUT /identity/v3/projects/bffa3a4ea11346d594eb1d24d945a257/users/c71667743d2c4a10a86c6f48c60edc67/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:46:52.885045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f471b-4c57-4283-9a20-35488dc83e80 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:52.885338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f471b-4c57-4283-9a20-35488dc83e80 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:52.885615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f471b-4c57-4283-9a20-35488dc83e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:52.911723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-525f471b-4c57-4283-9a20-35488dc83e80 None None] MFA Rules not processed for user `c71667743d2c4a10a86c6f48c60edc67`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:46:52.912985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-525f471b-4c57-4283-9a20-35488dc83e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:52.978859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1319/2633] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:46:52.988894 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714167-3e76-4471-9976-01e6708c1285 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:52.990723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f0714167-3e76-4471-9976-01e6708c1285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:46:53.047568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0714167-3e76-4471-9976-01e6708c1285 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:53.051206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0a60-6360-4bab-978f-ed441ded0d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:53.051839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0a60-6360-4bab-978f-ed441ded0d5a service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:53.052122 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0a60-6360-4bab-978f-ed441ded0d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:53.052426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0a60-6360-4bab-978f-ed441ded0d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:53.061261 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad0a60-6360-4bab-978f-ed441ded0d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:53.062675 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad0a60-6360-4bab-978f-ed441ded0d5a service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:53.072737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1315/2634] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:52 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:46:53.141999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f471b-4c57-4283-9a20-35488dc83e80 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:46:53.151949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f471b-4c57-4283-9a20-35488dc83e80 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:46:53.155768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92148c42-1074-441f-89d4-3faf9faeaedc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:46:53.156420 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148c42-1074-441f-89d4-3faf9faeaedc service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:46:53.156700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148c42-1074-441f-89d4-3faf9faeaedc service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:46:53.156974 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92148c42-1074-441f-89d4-3faf9faeaedc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:46:53.221434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92148c42-1074-441f-89d4-3faf9faeaedc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:46:53.222884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92148c42-1074-441f-89d4-3faf9faeaedc service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:46:53.234416 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1320/2635] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:46:53 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:07.598133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0a60-6360-4bab-978f-ed441ded0d5a service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:07.657734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0a60-6360-4bab-978f-ed441ded0d5a service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:07.662432 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:07.663283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:07.663556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:07.663860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] PATH_INFO: `/v3/users/99cba1f76e9f4984a6e9a305f0c8485b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:07.665692 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99cba1f76e9f4984a6e9a305f0c8485b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:07.667578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:07.710480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99cba1f76e9f4984a6e9a305f0c8485b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:07.717503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99cba1f76e9f4984a6e9a305f0c8485b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:07.729195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99cba1f76e9f4984a6e9a305f0c8485b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:07.729845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99cba1f76e9f4984a6e9a305f0c8485b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:07.736615 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99cba1f76e9f4984a6e9a305f0c8485b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:07.742246 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1316/2636] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:07 2022] DELETE /identity/v3/users/99cba1f76e9f4984a6e9a305f0c8485b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:07.746775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f972d-402c-4fdb-a3f7-043c62452f2f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:07.747240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f972d-402c-4fdb-a3f7-043c62452f2f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:07.747344 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f972d-402c-4fdb-a3f7-043c62452f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:07.764243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-825f972d-402c-4fdb-a3f7-043c62452f2f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:07.765470 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-825f972d-402c-4fdb-a3f7-043c62452f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:07.821979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1321/2637] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:07.831684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:07.833113 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:07.888682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276101ae-8fad-4a86-b0c4-770ce1b9ba7a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:07.892331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de37d36-290d-4b71-867a-3ec2e3ef11a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:07.892992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de37d36-290d-4b71-867a-3ec2e3ef11a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:07.893274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de37d36-290d-4b71-867a-3ec2e3ef11a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:07.893550 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de37d36-290d-4b71-867a-3ec2e3ef11a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:07.903027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de37d36-290d-4b71-867a-3ec2e3ef11a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:07.904491 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de37d36-290d-4b71-867a-3ec2e3ef11a0 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:07.913900 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1317/2638] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:08.171181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f972d-402c-4fdb-a3f7-043c62452f2f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:08.172685 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-825f972d-402c-4fdb-a3f7-043c62452f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:08.188935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f972d-402c-4fdb-a3f7-043c62452f2f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:08.194648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:08.195497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:08.195770 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:08.196853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] PATH_INFO: `/v3/projects/28e91b7a855041bd84a77f48a893fa8e` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:08.198024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e91b7a855041bd84a77f48a893fa8e)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:08.199908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:08.245171 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e91b7a855041bd84a77f48a893fa8e', 'request_id': 'req-de7dea34-fbe1-44cc-bf38-82597b311812'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.251255 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e91b7a855041bd84a77f48a893fa8e', 'request_id': 'req-de7dea34-fbe1-44cc-bf38-82597b311812'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.258382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e91b7a855041bd84a77f48a893fa8e', 'request_id': 'req-de7dea34-fbe1-44cc-bf38-82597b311812'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.269040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] The token cache is being invalidate because project 28e91b7a855041bd84a77f48a893fa8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:08.269327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.269948 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.271483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1322/2639] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:08 2022] DELETE /identity/v3/projects/28e91b7a855041bd84a77f48a893fa8e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:08.276184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de37d36-290d-4b71-867a-3ec2e3ef11a0 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:08.285570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de37d36-290d-4b71-867a-3ec2e3ef11a0 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:08.339485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:08.340337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:08.340651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:08.340921 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] PATH_INFO: `/v3/users/c71667743d2c4a10a86c6f48c60edc67` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:08.342100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71667743d2c4a10a86c6f48c60edc67)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:08.343976 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:08.386875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71667743d2c4a10a86c6f48c60edc67'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.393431 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71667743d2c4a10a86c6f48c60edc67'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.404764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71667743d2c4a10a86c6f48c60edc67'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.405427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71667743d2c4a10a86c6f48c60edc67'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.412408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64b3b8be-4cc3-426d-9784-c74e5eb1f5e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71667743d2c4a10a86c6f48c60edc67'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.418234 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1318/2640] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:08 2022] DELETE /identity/v3/users/c71667743d2c4a10a86c6f48c60edc67 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:47:08.671309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:08.672805 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:08.691898 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7dea34-fbe1-44cc-bf38-82597b311812 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:08.747823 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:08.748708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:08.748988 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:08.749263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] PATH_INFO: `/v3/projects/bffa3a4ea11346d594eb1d24d945a257` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:08.750452 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bffa3a4ea11346d594eb1d24d945a257)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:08.752366 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:08.798840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bffa3a4ea11346d594eb1d24d945a257', 'request_id': 'req-1ee83630-1214-49a6-a4a3-878c7d3b38ef'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.804749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bffa3a4ea11346d594eb1d24d945a257', 'request_id': 'req-1ee83630-1214-49a6-a4a3-878c7d3b38ef'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.812059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bffa3a4ea11346d594eb1d24d945a257', 'request_id': 'req-1ee83630-1214-49a6-a4a3-878c7d3b38ef'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.823660 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] The token cache is being invalidate because project bffa3a4ea11346d594eb1d24d945a257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:08.823944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.824711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1ee83630-1214-49a6-a4a3-878c7d3b38ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:08.826243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1323/2641] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:08 2022] DELETE /identity/v3/projects/bffa3a4ea11346d594eb1d24d945a257 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:08.832449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad42ab-f021-40b6-94f2-3bddaf4d89d5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:08.832914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad42ab-f021-40b6-94f2-3bddaf4d89d5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:08.833018 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad42ab-f021-40b6-94f2-3bddaf4d89d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:08.851512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-23ad42ab-f021-40b6-94f2-3bddaf4d89d5 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:08.852783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-23ad42ab-f021-40b6-94f2-3bddaf4d89d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:08.908697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1319/2642] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:08.916818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503740c5-7dbb-4e29-935b-882f3beaa94f None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:08.917100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503740c5-7dbb-4e29-935b-882f3beaa94f None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:08.917373 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503740c5-7dbb-4e29-935b-882f3beaa94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:08.935490 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-503740c5-7dbb-4e29-935b-882f3beaa94f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:08.936650 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-503740c5-7dbb-4e29-935b-882f3beaa94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:08.944516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1324/2643] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:08.949371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad42ab-f021-40b6-94f2-3bddaf4d89d5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:08.958704 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad42ab-f021-40b6-94f2-3bddaf4d89d5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:08.963899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1ec4-2d8b-4c9e-adf9-d70a24a716e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:08.964578 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1ec4-2d8b-4c9e-adf9-d70a24a716e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:08.964855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1ec4-2d8b-4c9e-adf9-d70a24a716e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:08.965123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f1ec4-2d8b-4c9e-adf9-d70a24a716e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:08.965945 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1ec4-2d8b-4c9e-adf9-d70a24a716e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:47:08.966250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1ec4-2d8b-4c9e-adf9-d70a24a716e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:08.967811 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f1ec4-2d8b-4c9e-adf9-d70a24a716e3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:08.978908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1320/2644] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:47:08.983105 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503740c5-7dbb-4e29-935b-882f3beaa94f None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:08.992144 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503740c5-7dbb-4e29-935b-882f3beaa94f None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:08.996837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be608f79-eb7e-4fba-a1c5-2ec69a9c73e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:08.997478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be608f79-eb7e-4fba-a1c5-2ec69a9c73e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:08.997759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be608f79-eb7e-4fba-a1c5-2ec69a9c73e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:08.998030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be608f79-eb7e-4fba-a1c5-2ec69a9c73e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:08.998735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be608f79-eb7e-4fba-a1c5-2ec69a9c73e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.000657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be608f79-eb7e-4fba-a1c5-2ec69a9c73e5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.034700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1325/2645] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:08 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:09.038764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1ec4-2d8b-4c9e-adf9-d70a24a716e3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.048495 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f1ec4-2d8b-4c9e-adf9-d70a24a716e3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.102358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24c41f-b1b3-4541-9f19-8d6da4cd1232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.103007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24c41f-b1b3-4541-9f19-8d6da4cd1232 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.103287 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24c41f-b1b3-4541-9f19-8d6da4cd1232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.103561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24c41f-b1b3-4541-9f19-8d6da4cd1232 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.104248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24c41f-b1b3-4541-9f19-8d6da4cd1232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.106179 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24c41f-b1b3-4541-9f19-8d6da4cd1232 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.126471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1321/2646] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:09 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:09.130512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be608f79-eb7e-4fba-a1c5-2ec69a9c73e5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.141127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be608f79-eb7e-4fba-a1c5-2ec69a9c73e5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.145697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5696d3d-8dac-4617-b9a2-8ffde7864a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.146347 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5696d3d-8dac-4617-b9a2-8ffde7864a19 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.146625 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5696d3d-8dac-4617-b9a2-8ffde7864a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.146896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5696d3d-8dac-4617-b9a2-8ffde7864a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.147755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5696d3d-8dac-4617-b9a2-8ffde7864a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.149254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5696d3d-8dac-4617-b9a2-8ffde7864a19 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.158934 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1326/2647] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:09.162862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24c41f-b1b3-4541-9f19-8d6da4cd1232 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.172595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24c41f-b1b3-4541-9f19-8d6da4cd1232 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.177130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59717a0-d9dd-4ad8-870c-2e006a14dedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.177774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59717a0-d9dd-4ad8-870c-2e006a14dedc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.178052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59717a0-d9dd-4ad8-870c-2e006a14dedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.178323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59717a0-d9dd-4ad8-870c-2e006a14dedc admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.179050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59717a0-d9dd-4ad8-870c-2e006a14dedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.181195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59717a0-d9dd-4ad8-870c-2e006a14dedc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.190934 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1322/2648] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:09.194784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5696d3d-8dac-4617-b9a2-8ffde7864a19 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.205232 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5696d3d-8dac-4617-b9a2-8ffde7864a19 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.209838 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6c885-b058-4b25-93fe-b139bc126e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.210727 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6c885-b058-4b25-93fe-b139bc126e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.211002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6c885-b058-4b25-93fe-b139bc126e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.211272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6c885-b058-4b25-93fe-b139bc126e1e admin admin] PATH_INFO: `/v3/projects/55def152ca094d028f8b61e453717e6b/users/a0297dc3e43444f9a385bdc589d7a727/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.225816 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6c885-b058-4b25-93fe-b139bc126e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=55def152ca094d028f8b61e453717e6b, user_id=a0297dc3e43444f9a385bdc589d7a727, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.228474 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6c885-b058-4b25-93fe-b139bc126e1e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.242452 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1327/2649] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:09 2022] PUT /identity/v3/projects/55def152ca094d028f8b61e453717e6b/users/a0297dc3e43444f9a385bdc589d7a727/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:09.254084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9391b73-2c3e-4c8e-8848-fdcd5aa69c7d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.254373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9391b73-2c3e-4c8e-8848-fdcd5aa69c7d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.254647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9391b73-2c3e-4c8e-8848-fdcd5aa69c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.280646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f9391b73-2c3e-4c8e-8848-fdcd5aa69c7d None None] MFA Rules not processed for user `a0297dc3e43444f9a385bdc589d7a727`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:09.281842 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f9391b73-2c3e-4c8e-8848-fdcd5aa69c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:09.343220 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1323/2650] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:09.347603 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6c885-b058-4b25-93fe-b139bc126e1e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.405533 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6c885-b058-4b25-93fe-b139bc126e1e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.410089 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5dfbb-62f1-490b-a8aa-0594b3f199b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.410721 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5dfbb-62f1-490b-a8aa-0594b3f199b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.410997 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5dfbb-62f1-490b-a8aa-0594b3f199b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.411268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5dfbb-62f1-490b-a8aa-0594b3f199b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.411956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5dfbb-62f1-490b-a8aa-0594b3f199b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.413864 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5dfbb-62f1-490b-a8aa-0594b3f199b5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.437669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1328/2651] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:09 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:09.441558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9391b73-2c3e-4c8e-8848-fdcd5aa69c7d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.452605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9391b73-2c3e-4c8e-8848-fdcd5aa69c7d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.505932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f03875-7fd8-4853-bff2-8fc0340927bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.506580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f03875-7fd8-4853-bff2-8fc0340927bb admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.506857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f03875-7fd8-4853-bff2-8fc0340927bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.507128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f03875-7fd8-4853-bff2-8fc0340927bb admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.508043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f03875-7fd8-4853-bff2-8fc0340927bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.510119 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f03875-7fd8-4853-bff2-8fc0340927bb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.528226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1324/2652] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:09 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:09.532381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5dfbb-62f1-490b-a8aa-0594b3f199b5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.542788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5dfbb-62f1-490b-a8aa-0594b3f199b5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.547456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed61f-350d-4461-b9fe-5265ea3b3b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.548102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed61f-350d-4461-b9fe-5265ea3b3b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.548432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed61f-350d-4461-b9fe-5265ea3b3b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.548743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed61f-350d-4461-b9fe-5265ea3b3b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.549467 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faed61f-350d-4461-b9fe-5265ea3b3b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.551090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faed61f-350d-4461-b9fe-5265ea3b3b58 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.561831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1329/2653] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:09.565655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f03875-7fd8-4853-bff2-8fc0340927bb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.575466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f03875-7fd8-4853-bff2-8fc0340927bb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.579970 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4816d81-155a-43e8-911b-6f06f565b058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.580878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4816d81-155a-43e8-911b-6f06f565b058 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.581152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4816d81-155a-43e8-911b-6f06f565b058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.581422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4816d81-155a-43e8-911b-6f06f565b058 admin admin] PATH_INFO: `/v3/projects/9b8bc96af51c4a06bcac7a64b32a79bb/users/f80f82744b1e40cd8d982c64ca85d507/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.596823 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4816d81-155a-43e8-911b-6f06f565b058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8bc96af51c4a06bcac7a64b32a79bb, user_id=f80f82744b1e40cd8d982c64ca85d507, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.599783 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4816d81-155a-43e8-911b-6f06f565b058 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.613743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1325/2654] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:09 2022] PUT /identity/v3/projects/9b8bc96af51c4a06bcac7a64b32a79bb/users/f80f82744b1e40cd8d982c64ca85d507/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:47:09.617572 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed61f-350d-4461-b9fe-5265ea3b3b58 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.627979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed61f-350d-4461-b9fe-5265ea3b3b58 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.680109 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b83d-48b5-4043-b45d-3b5455a5a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.681340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b83d-48b5-4043-b45d-3b5455a5a417 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.681614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b83d-48b5-4043-b45d-3b5455a5a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.681884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b83d-48b5-4043-b45d-3b5455a5a417 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.682600 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089b83d-48b5-4043-b45d-3b5455a5a417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.684181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089b83d-48b5-4043-b45d-3b5455a5a417 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.693690 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1330/2655] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:09.697859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4816d81-155a-43e8-911b-6f06f565b058 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.707796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4816d81-155a-43e8-911b-6f06f565b058 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.712377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c5391-e9eb-4157-9d8f-1c1a7880f4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.713238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c5391-e9eb-4157-9d8f-1c1a7880f4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.713514 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c5391-e9eb-4157-9d8f-1c1a7880f4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.713814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c5391-e9eb-4157-9d8f-1c1a7880f4a5 admin admin] PATH_INFO: `/v3/projects/9b8bc96af51c4a06bcac7a64b32a79bb/users/f80f82744b1e40cd8d982c64ca85d507/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.715757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c5391-e9eb-4157-9d8f-1c1a7880f4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8bc96af51c4a06bcac7a64b32a79bb, user_id=f80f82744b1e40cd8d982c64ca85d507, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.718380 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c5391-e9eb-4157-9d8f-1c1a7880f4a5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.728721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1326/2656] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:09 2022] PUT /identity/v3/projects/9b8bc96af51c4a06bcac7a64b32a79bb/users/f80f82744b1e40cd8d982c64ca85d507/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:09.738393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d707c-067c-42cf-8e04-b540614711a1 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.738676 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d707c-067c-42cf-8e04-b540614711a1 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.738956 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d707c-067c-42cf-8e04-b540614711a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.764890 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-5f8d707c-067c-42cf-8e04-b540614711a1 None None] MFA Rules not processed for user `f80f82744b1e40cd8d982c64ca85d507`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:09.766077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-5f8d707c-067c-42cf-8e04-b540614711a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:09.830254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1331/2657] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:09.839916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c5391-e9eb-4157-9d8f-1c1a7880f4a5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:09.841656 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-139c5391-e9eb-4157-9d8f-1c1a7880f4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:09.895568 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c5391-e9eb-4157-9d8f-1c1a7880f4a5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:09.899714 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df9602-bb84-4fb4-bce0-71c33d6a6b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:09.900362 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df9602-bb84-4fb4-bce0-71c33d6a6b20 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:09.900646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df9602-bb84-4fb4-bce0-71c33d6a6b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:09.900920 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df9602-bb84-4fb4-bce0-71c33d6a6b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:09.909795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df9602-bb84-4fb4-bce0-71c33d6a6b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:09.911205 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df9602-bb84-4fb4-bce0-71c33d6a6b20 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:09.921086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1327/2658] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:11.116975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d707c-067c-42cf-8e04-b540614711a1 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:11.176063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d707c-067c-42cf-8e04-b540614711a1 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:11.180578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:11.181592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:11.181959 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:11.182236 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] PATH_INFO: `/v3/users/a0297dc3e43444f9a385bdc589d7a727` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:11.183427 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0297dc3e43444f9a385bdc589d7a727)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:11.185381 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:11.230287 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0297dc3e43444f9a385bdc589d7a727'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.239800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0297dc3e43444f9a385bdc589d7a727'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.248002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0297dc3e43444f9a385bdc589d7a727'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.259298 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0297dc3e43444f9a385bdc589d7a727'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.260543 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0297dc3e43444f9a385bdc589d7a727'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.266288 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1332/2659] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:11 2022] DELETE /identity/v3/users/a0297dc3e43444f9a385bdc589d7a727 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:11.271159 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc1959-8489-422a-83ed-7c535d3e8daa None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:11.271635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc1959-8489-422a-83ed-7c535d3e8daa None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:11.271772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc1959-8489-422a-83ed-7c535d3e8daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:11.289607 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8ddc1959-8489-422a-83ed-7c535d3e8daa None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:11.290821 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8ddc1959-8489-422a-83ed-7c535d3e8daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:11.347563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1328/2660] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:11.357158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:11.358539 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:11.412799 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7739a92-04e3-4901-9a8a-8cd7088361c0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:11.416471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1a91b-4c3a-4b13-af31-615978f87cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:11.417099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1a91b-4c3a-4b13-af31-615978f87cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:11.417375 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1a91b-4c3a-4b13-af31-615978f87cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:11.417646 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1a91b-4c3a-4b13-af31-615978f87cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:11.426377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1a91b-4c3a-4b13-af31-615978f87cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:11.427805 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1a91b-4c3a-4b13-af31-615978f87cc3 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:11.437443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1333/2661] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:11.692723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc1959-8489-422a-83ed-7c535d3e8daa None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:11.694244 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8ddc1959-8489-422a-83ed-7c535d3e8daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:11.707908 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc1959-8489-422a-83ed-7c535d3e8daa None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:11.714021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:11.714981 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:11.715345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:11.715527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] PATH_INFO: `/v3/projects/55def152ca094d028f8b61e453717e6b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:11.716758 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55def152ca094d028f8b61e453717e6b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:11.718703 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:11.764078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55def152ca094d028f8b61e453717e6b', 'request_id': 'req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.770047 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55def152ca094d028f8b61e453717e6b', 'request_id': 'req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.775658 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55def152ca094d028f8b61e453717e6b', 'request_id': 'req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.787726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] The token cache is being invalidate because project 55def152ca094d028f8b61e453717e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:11.787952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.788586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.790108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1329/2662] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:11 2022] DELETE /identity/v3/projects/55def152ca094d028f8b61e453717e6b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:11.794593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1a91b-4c3a-4b13-af31-615978f87cc3 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:11.803895 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1a91b-4c3a-4b13-af31-615978f87cc3 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:11.858615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:11.859471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:11.859746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:11.860020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] PATH_INFO: `/v3/users/f80f82744b1e40cd8d982c64ca85d507` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:11.861233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80f82744b1e40cd8d982c64ca85d507)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:11.863161 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:11.905396 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80f82744b1e40cd8d982c64ca85d507'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.912256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80f82744b1e40cd8d982c64ca85d507'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.919414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80f82744b1e40cd8d982c64ca85d507'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.930755 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80f82744b1e40cd8d982c64ca85d507'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.932033 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9475d1be-e78f-4e2e-8ccb-0310d349d356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80f82744b1e40cd8d982c64ca85d507'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:11.938012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1334/2663] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:11 2022] DELETE /identity/v3/users/f80f82744b1e40cd8d982c64ca85d507 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:12.199124 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:12.200602 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:12.213522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce8dc8-1c06-4cc8-8ca7-4d6ad64780c6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:12.267490 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:12.268337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.268647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.268918 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] PATH_INFO: `/v3/projects/9b8bc96af51c4a06bcac7a64b32a79bb` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.270108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8bc96af51c4a06bcac7a64b32a79bb)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:12.271960 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:12.316168 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8bc96af51c4a06bcac7a64b32a79bb', 'request_id': 'req-3cba35c3-e629-4616-a1b5-854fc960d0fc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:12.323187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8bc96af51c4a06bcac7a64b32a79bb', 'request_id': 'req-3cba35c3-e629-4616-a1b5-854fc960d0fc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:12.328569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8bc96af51c4a06bcac7a64b32a79bb', 'request_id': 'req-3cba35c3-e629-4616-a1b5-854fc960d0fc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:12.339887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] The token cache is being invalidate because project 9b8bc96af51c4a06bcac7a64b32a79bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:12.340170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:12.340837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3cba35c3-e629-4616-a1b5-854fc960d0fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:12.342327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1330/2664] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:12 2022] DELETE /identity/v3/projects/9b8bc96af51c4a06bcac7a64b32a79bb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:12.348040 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efe023-928a-47bf-817d-30b854c7e89c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.348520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efe023-928a-47bf-817d-30b854c7e89c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.348765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efe023-928a-47bf-817d-30b854c7e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.366289 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-e6efe023-928a-47bf-817d-30b854c7e89c None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:12.367478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-e6efe023-928a-47bf-817d-30b854c7e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:12.424310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1335/2665] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:12.433626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8438597-094a-44d9-9057-12633fb8af23 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.433914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8438597-094a-44d9-9057-12633fb8af23 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.434198 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8438597-094a-44d9-9057-12633fb8af23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.452092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f8438597-094a-44d9-9057-12633fb8af23 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:12.453318 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f8438597-094a-44d9-9057-12633fb8af23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:12.461045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1331/2666] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:12.465006 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efe023-928a-47bf-817d-30b854c7e89c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:12.474339 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efe023-928a-47bf-817d-30b854c7e89c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:12.479417 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bff72-4e10-4f4c-8fbf-fe4940a5bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:12.480055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bff72-4e10-4f4c-8fbf-fe4940a5bdcd admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.480332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bff72-4e10-4f4c-8fbf-fe4940a5bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.480633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bff72-4e10-4f4c-8fbf-fe4940a5bdcd admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.481355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bff72-4e10-4f4c-8fbf-fe4940a5bdcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:47:12.481656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bff72-4e10-4f4c-8fbf-fe4940a5bdcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:12.483237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bff72-4e10-4f4c-8fbf-fe4940a5bdcd admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:12.494985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1336/2667] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:47:12.499027 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8438597-094a-44d9-9057-12633fb8af23 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:12.508022 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8438597-094a-44d9-9057-12633fb8af23 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:12.512728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221304-e1a0-4b81-8748-f95f011d9935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:12.513368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221304-e1a0-4b81-8748-f95f011d9935 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.513646 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221304-e1a0-4b81-8748-f95f011d9935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.513939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40221304-e1a0-4b81-8748-f95f011d9935 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.514630 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40221304-e1a0-4b81-8748-f95f011d9935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:12.516554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40221304-e1a0-4b81-8748-f95f011d9935 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:12.544084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1332/2668] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:12 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:12.545565 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bff72-4e10-4f4c-8fbf-fe4940a5bdcd admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:12.555203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bff72-4e10-4f4c-8fbf-fe4940a5bdcd admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:12.608473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047a049-e2b3-4ad5-a2aa-393483a231ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:12.609026 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047a049-e2b3-4ad5-a2aa-393483a231ae admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.609304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047a049-e2b3-4ad5-a2aa-393483a231ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.609577 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047a049-e2b3-4ad5-a2aa-393483a231ae admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.610279 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047a049-e2b3-4ad5-a2aa-393483a231ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:12.612188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047a049-e2b3-4ad5-a2aa-393483a231ae admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:12.631855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1337/2669] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:12 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:12.635868 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221304-e1a0-4b81-8748-f95f011d9935 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:12.645912 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40221304-e1a0-4b81-8748-f95f011d9935 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:12.650748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b74c23-c96a-4833-a9e3-614c19ed4412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:12.651447 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b74c23-c96a-4833-a9e3-614c19ed4412 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.651724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b74c23-c96a-4833-a9e3-614c19ed4412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.651998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b74c23-c96a-4833-a9e3-614c19ed4412 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.652794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b74c23-c96a-4833-a9e3-614c19ed4412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:12.654415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b74c23-c96a-4833-a9e3-614c19ed4412 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:12.664588 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1333/2670] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:12.668669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047a049-e2b3-4ad5-a2aa-393483a231ae admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:12.678404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047a049-e2b3-4ad5-a2aa-393483a231ae admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:12.683614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f3bff-3678-480a-a5b7-9cf64d361b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:12.684257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f3bff-3678-480a-a5b7-9cf64d361b32 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.684564 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f3bff-3678-480a-a5b7-9cf64d361b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.684837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f3bff-3678-480a-a5b7-9cf64d361b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.685558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f3bff-3678-480a-a5b7-9cf64d361b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:12.687159 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f3bff-3678-480a-a5b7-9cf64d361b32 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:12.697075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1338/2671] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:12.701046 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b74c23-c96a-4833-a9e3-614c19ed4412 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:12.710966 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b74c23-c96a-4833-a9e3-614c19ed4412 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:12.715558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b7298-b860-40c5-b10b-a5d6dda780e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:12.716454 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b7298-b860-40c5-b10b-a5d6dda780e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.716734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b7298-b860-40c5-b10b-a5d6dda780e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.717006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b7298-b860-40c5-b10b-a5d6dda780e0 admin admin] PATH_INFO: `/v3/projects/abf125799c7146a9b5c1e0abc67322e7/users/c427336d3ef64aff80a4c9969fe24046/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.731492 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b7298-b860-40c5-b10b-a5d6dda780e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf125799c7146a9b5c1e0abc67322e7, user_id=c427336d3ef64aff80a4c9969fe24046, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:12.734164 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b7298-b860-40c5-b10b-a5d6dda780e0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:12.746573 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1334/2672] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:12 2022] PUT /identity/v3/projects/abf125799c7146a9b5c1e0abc67322e7/users/c427336d3ef64aff80a4c9969fe24046/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:12.756767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143c70e-17e5-49f6-8068-328452efa9ff None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.757149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143c70e-17e5-49f6-8068-328452efa9ff None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.757489 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143c70e-17e5-49f6-8068-328452efa9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.784553 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-c143c70e-17e5-49f6-8068-328452efa9ff None None] MFA Rules not processed for user `c427336d3ef64aff80a4c9969fe24046`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:12.785773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c143c70e-17e5-49f6-8068-328452efa9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:12.848407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1339/2673] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:12.852944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b7298-b860-40c5-b10b-a5d6dda780e0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:12.911499 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b7298-b860-40c5-b10b-a5d6dda780e0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:12.916302 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a700b2-6253-4c8d-a894-cd61f0490d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:12.917009 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a700b2-6253-4c8d-a894-cd61f0490d4b admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:12.917291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a700b2-6253-4c8d-a894-cd61f0490d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:12.917567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a700b2-6253-4c8d-a894-cd61f0490d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:12.918365 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a700b2-6253-4c8d-a894-cd61f0490d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:12.920290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a700b2-6253-4c8d-a894-cd61f0490d4b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:12.944845 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1335/2674] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:12 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:12.949214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143c70e-17e5-49f6-8068-328452efa9ff None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:12.959534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143c70e-17e5-49f6-8068-328452efa9ff None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:13.014408 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b844fe2-8bfc-484c-90eb-61b7387a3626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:13.015107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b844fe2-8bfc-484c-90eb-61b7387a3626 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:13.015386 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b844fe2-8bfc-484c-90eb-61b7387a3626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:13.015663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b844fe2-8bfc-484c-90eb-61b7387a3626 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:13.016419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b844fe2-8bfc-484c-90eb-61b7387a3626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:13.018327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b844fe2-8bfc-484c-90eb-61b7387a3626 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:13.042000 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1340/2675] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:12 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:13.045736 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a700b2-6253-4c8d-a894-cd61f0490d4b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:13.056178 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a700b2-6253-4c8d-a894-cd61f0490d4b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:13.061485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f4458-1826-4da9-8ab2-e60745e09bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:13.062136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4458-1826-4da9-8ab2-e60745e09bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:13.062416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4458-1826-4da9-8ab2-e60745e09bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:13.062693 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4458-1826-4da9-8ab2-e60745e09bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:13.063424 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f4458-1826-4da9-8ab2-e60745e09bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:13.065060 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f4458-1826-4da9-8ab2-e60745e09bb2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:13.076187 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1336/2676] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:13.080035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b844fe2-8bfc-484c-90eb-61b7387a3626 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:13.089859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b844fe2-8bfc-484c-90eb-61b7387a3626 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:13.094511 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb0d22-bd86-4bce-8334-bba9ef63e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:13.095391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb0d22-bd86-4bce-8334-bba9ef63e161 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:13.095648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb0d22-bd86-4bce-8334-bba9ef63e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:13.095919 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb0d22-bd86-4bce-8334-bba9ef63e161 admin admin] PATH_INFO: `/v3/projects/7b9a107c9e774cc89e91d0c77134f185/users/327a5829c39c4f97be7a780862f69931/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:13.110095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb0d22-bd86-4bce-8334-bba9ef63e161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9a107c9e774cc89e91d0c77134f185, user_id=327a5829c39c4f97be7a780862f69931, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:13.112770 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb0d22-bd86-4bce-8334-bba9ef63e161 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:13.125295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1341/2677] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:13 2022] PUT /identity/v3/projects/7b9a107c9e774cc89e91d0c77134f185/users/327a5829c39c4f97be7a780862f69931/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:13.129158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f4458-1826-4da9-8ab2-e60745e09bb2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:13.139446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f4458-1826-4da9-8ab2-e60745e09bb2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:13.193746 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dcb30-e9eb-4991-b751-b5b58daf5a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:13.194321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dcb30-e9eb-4991-b751-b5b58daf5a50 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:13.194601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dcb30-e9eb-4991-b751-b5b58daf5a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:13.194864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dcb30-e9eb-4991-b751-b5b58daf5a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:13.195581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9dcb30-e9eb-4991-b751-b5b58daf5a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:13.197504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9dcb30-e9eb-4991-b751-b5b58daf5a50 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:13.207233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1337/2678] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:13.211400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb0d22-bd86-4bce-8334-bba9ef63e161 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:13.221680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb0d22-bd86-4bce-8334-bba9ef63e161 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:13.226356 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f42c0f-88ee-40a3-afac-0b6b152c8c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:13.227220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f42c0f-88ee-40a3-afac-0b6b152c8c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:13.227506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f42c0f-88ee-40a3-afac-0b6b152c8c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:13.227783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f42c0f-88ee-40a3-afac-0b6b152c8c84 admin admin] PATH_INFO: `/v3/projects/7b9a107c9e774cc89e91d0c77134f185/users/327a5829c39c4f97be7a780862f69931/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:13.230391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f42c0f-88ee-40a3-afac-0b6b152c8c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9a107c9e774cc89e91d0c77134f185, user_id=327a5829c39c4f97be7a780862f69931, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:13.233036 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f42c0f-88ee-40a3-afac-0b6b152c8c84 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:13.242985 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1342/2679] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:13 2022] PUT /identity/v3/projects/7b9a107c9e774cc89e91d0c77134f185/users/327a5829c39c4f97be7a780862f69931/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:13.256282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa15a-2e2d-434a-83c5-f7fa34ecb9e4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:13.256789 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa15a-2e2d-434a-83c5-f7fa34ecb9e4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:13.257719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa15a-2e2d-434a-83c5-f7fa34ecb9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:13.282929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-cc4fa15a-2e2d-434a-83c5-f7fa34ecb9e4 None None] MFA Rules not processed for user `327a5829c39c4f97be7a780862f69931`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:13.284116 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cc4fa15a-2e2d-434a-83c5-f7fa34ecb9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:13.349134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1338/2680] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:13.359039 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f42c0f-88ee-40a3-afac-0b6b152c8c84 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:13.360808 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f4f42c0f-88ee-40a3-afac-0b6b152c8c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:13.414746 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f42c0f-88ee-40a3-afac-0b6b152c8c84 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:13.418949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577290c0-8115-49c9-8da0-c00e04b0b247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:13.419571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577290c0-8115-49c9-8da0-c00e04b0b247 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:13.419848 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577290c0-8115-49c9-8da0-c00e04b0b247 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:13.420117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577290c0-8115-49c9-8da0-c00e04b0b247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:13.473734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577290c0-8115-49c9-8da0-c00e04b0b247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:13.475097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577290c0-8115-49c9-8da0-c00e04b0b247 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:13.484269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1343/2681] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:18.035797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fa15a-2e2d-434a-83c5-f7fa34ecb9e4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:18.037239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cc4fa15a-2e2d-434a-83c5-f7fa34ecb9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:18.048980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fa15a-2e2d-434a-83c5-f7fa34ecb9e4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:18.052522 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf9c5d-70e9-4e60-99d2-ee92b5768252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:18.053147 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf9c5d-70e9-4e60-99d2-ee92b5768252 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:18.053422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf9c5d-70e9-4e60-99d2-ee92b5768252 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:18.053690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf9c5d-70e9-4e60-99d2-ee92b5768252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:18.063219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf9c5d-70e9-4e60-99d2-ee92b5768252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:18.064665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf9c5d-70e9-4e60-99d2-ee92b5768252 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:18.074726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1339/2682] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:27.066506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577290c0-8115-49c9-8da0-c00e04b0b247 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:27.067923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-577290c0-8115-49c9-8da0-c00e04b0b247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:27.122639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577290c0-8115-49c9-8da0-c00e04b0b247 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:27.126250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3909a-d360-465e-ab25-45789c646633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:27.126887 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3909a-d360-465e-ab25-45789c646633 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:27.127166 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3909a-d360-465e-ab25-45789c646633 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:27.127440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3909a-d360-465e-ab25-45789c646633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:27.129194 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-aca3909a-d360-465e-ab25-45789c646633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:27.191320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3909a-d360-465e-ab25-45789c646633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:27.192806 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3909a-d360-465e-ab25-45789c646633 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:27.203583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1344/2683] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:30.364089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf9c5d-70e9-4e60-99d2-ee92b5768252 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:30.368135 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ecaf9c5d-70e9-4e60-99d2-ee92b5768252 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:30.387856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf9c5d-70e9-4e60-99d2-ee92b5768252 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:30.391169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:30.392049 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:30.392323 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:30.392655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] PATH_INFO: `/v3/users/4a6e100dfcd5498fa5e2a5a1b04429dd` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:30.393985 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6e100dfcd5498fa5e2a5a1b04429dd)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:30.395997 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:30.445204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6e100dfcd5498fa5e2a5a1b04429dd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:30.456728 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6e100dfcd5498fa5e2a5a1b04429dd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:30.463768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6e100dfcd5498fa5e2a5a1b04429dd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:30.464520 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6e100dfcd5498fa5e2a5a1b04429dd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:30.472148 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca772fbc-6cd5-46c3-977f-5abb17897e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6e100dfcd5498fa5e2a5a1b04429dd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:30.478274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1340/2684] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:30 2022] DELETE /identity/v3/users/4a6e100dfcd5498fa5e2a5a1b04429dd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:30.865216 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3909a-d360-465e-ab25-45789c646633 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:30.876494 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3909a-d360-465e-ab25-45789c646633 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:31.060443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:31.061203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.061476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.061744 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] PATH_INFO: `/v3/projects/ea62fa68252a4419b7f8fe2873512277` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.062899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea62fa68252a4419b7f8fe2873512277)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:31.064789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:31.107183 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea62fa68252a4419b7f8fe2873512277', 'request_id': 'req-9c2b87ae-deff-4600-8358-7200d37d7583'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:31.113058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea62fa68252a4419b7f8fe2873512277', 'request_id': 'req-9c2b87ae-deff-4600-8358-7200d37d7583'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:31.119797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea62fa68252a4419b7f8fe2873512277', 'request_id': 'req-9c2b87ae-deff-4600-8358-7200d37d7583'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:31.129268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] The token cache is being invalidate because project ea62fa68252a4419b7f8fe2873512277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:31.129549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:31.130153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9c2b87ae-deff-4600-8358-7200d37d7583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:31.131825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1345/2685] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:30 2022] DELETE /identity/v3/projects/ea62fa68252a4419b7f8fe2873512277 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:31.138096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999915ca-8080-428e-8fd9-74be86f5b81f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.138408 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999915ca-8080-428e-8fd9-74be86f5b81f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.138681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999915ca-8080-428e-8fd9-74be86f5b81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.157166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-999915ca-8080-428e-8fd9-74be86f5b81f None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:31.158345 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-999915ca-8080-428e-8fd9-74be86f5b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:31.213872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1341/2686] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:31.221602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecd00f-9b33-4b4c-b635-5b133af07035 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.221885 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecd00f-9b33-4b4c-b635-5b133af07035 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.222162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecd00f-9b33-4b4c-b635-5b133af07035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.239732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-2cecd00f-9b33-4b4c-b635-5b133af07035 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:31.240941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2cecd00f-9b33-4b4c-b635-5b133af07035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:31.248879 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1346/2687] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:31.252887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999915ca-8080-428e-8fd9-74be86f5b81f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:31.262721 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999915ca-8080-428e-8fd9-74be86f5b81f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:31.267182 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e2d30-3da8-4e2e-8a48-583689385241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:31.267816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e2d30-3da8-4e2e-8a48-583689385241 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.268090 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e2d30-3da8-4e2e-8a48-583689385241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.268378 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e2d30-3da8-4e2e-8a48-583689385241 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.269103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e2d30-3da8-4e2e-8a48-583689385241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:47:31.269406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e2d30-3da8-4e2e-8a48-583689385241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:31.270966 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e2d30-3da8-4e2e-8a48-583689385241 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:31.282632 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1342/2688] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 07 02:47:31.286713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecd00f-9b33-4b4c-b635-5b133af07035 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:31.295476 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecd00f-9b33-4b4c-b635-5b133af07035 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:31.300075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cd4e7-5952-42a3-ba48-7679b0d59003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:31.300745 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd4e7-5952-42a3-ba48-7679b0d59003 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.301017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd4e7-5952-42a3-ba48-7679b0d59003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.301285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cd4e7-5952-42a3-ba48-7679b0d59003 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.301973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cd4e7-5952-42a3-ba48-7679b0d59003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:31.303831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cd4e7-5952-42a3-ba48-7679b0d59003 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:31.328877 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1347/2689] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:31 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:31.333166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e2d30-3da8-4e2e-8a48-583689385241 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:31.343661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e2d30-3da8-4e2e-8a48-583689385241 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:31.397962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ad1c1-0285-4e43-98b8-d1053ed41e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:31.398625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ad1c1-0285-4e43-98b8-d1053ed41e38 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.398901 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ad1c1-0285-4e43-98b8-d1053ed41e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.399169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ad1c1-0285-4e43-98b8-d1053ed41e38 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.399866 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ad1c1-0285-4e43-98b8-d1053ed41e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:31.402373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ad1c1-0285-4e43-98b8-d1053ed41e38 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:31.422002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1343/2690] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:31 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:31.425987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cd4e7-5952-42a3-ba48-7679b0d59003 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:31.436291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cd4e7-5952-42a3-ba48-7679b0d59003 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:31.440876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d0ea4-764c-456d-b66b-3f41d3c6abf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:31.441520 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d0ea4-764c-456d-b66b-3f41d3c6abf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.441795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d0ea4-764c-456d-b66b-3f41d3c6abf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.442066 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d0ea4-764c-456d-b66b-3f41d3c6abf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.442790 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d0ea4-764c-456d-b66b-3f41d3c6abf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:31.444383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d0ea4-764c-456d-b66b-3f41d3c6abf6 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:31.455055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1348/2691] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:31.458873 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ad1c1-0285-4e43-98b8-d1053ed41e38 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:31.469956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ad1c1-0285-4e43-98b8-d1053ed41e38 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:31.475112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329b3bd-d8ea-4ffb-bfb5-642626f4eef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:31.475772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329b3bd-d8ea-4ffb-bfb5-642626f4eef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.476045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329b3bd-d8ea-4ffb-bfb5-642626f4eef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.476504 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329b3bd-d8ea-4ffb-bfb5-642626f4eef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.477252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329b3bd-d8ea-4ffb-bfb5-642626f4eef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:31.478910 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329b3bd-d8ea-4ffb-bfb5-642626f4eef8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:31.488998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1344/2692] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:31.493163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d0ea4-764c-456d-b66b-3f41d3c6abf6 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:31.502814 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d0ea4-764c-456d-b66b-3f41d3c6abf6 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:31.507343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459a1b1-b111-44d7-ac1a-17a6a3cf34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:31.508198 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459a1b1-b111-44d7-ac1a-17a6a3cf34a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.508510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459a1b1-b111-44d7-ac1a-17a6a3cf34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.508782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459a1b1-b111-44d7-ac1a-17a6a3cf34a0 admin admin] PATH_INFO: `/v3/projects/32ffab3576ce4eaeb40893e31d8af4d7/users/6c6d72bf582542e589f547d810ad9f69/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.523017 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459a1b1-b111-44d7-ac1a-17a6a3cf34a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ffab3576ce4eaeb40893e31d8af4d7, user_id=6c6d72bf582542e589f547d810ad9f69, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:31.526332 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459a1b1-b111-44d7-ac1a-17a6a3cf34a0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:31.538582 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1349/2693] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:31 2022] PUT /identity/v3/projects/32ffab3576ce4eaeb40893e31d8af4d7/users/6c6d72bf582542e589f547d810ad9f69/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:47:31.543672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d9619-246e-4a72-863f-da949ffd94d3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.543959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d9619-246e-4a72-863f-da949ffd94d3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.544233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d9619-246e-4a72-863f-da949ffd94d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.561854 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-109d9619-246e-4a72-863f-da949ffd94d3 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:31.563026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-109d9619-246e-4a72-863f-da949ffd94d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:31.617552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1345/2694] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:47:31.627688 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459a1b1-b111-44d7-ac1a-17a6a3cf34a0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:31.629617 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b459a1b1-b111-44d7-ac1a-17a6a3cf34a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:31.684222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459a1b1-b111-44d7-ac1a-17a6a3cf34a0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:31.687825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236495bb-eab2-49c6-8335-3885f577871f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:31.688566 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236495bb-eab2-49c6-8335-3885f577871f service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:31.688850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236495bb-eab2-49c6-8335-3885f577871f service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:31.689124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236495bb-eab2-49c6-8335-3885f577871f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:31.698779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236495bb-eab2-49c6-8335-3885f577871f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:31.700217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236495bb-eab2-49c6-8335-3885f577871f service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:31.709427 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1350/2695] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:32.546157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76877-aa22-4557-aa7a-de5fd4961a76 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:32.546653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76877-aa22-4557-aa7a-de5fd4961a76 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:32.546831 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf76877-aa22-4557-aa7a-de5fd4961a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:32.580599 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0cf76877-aa22-4557-aa7a-de5fd4961a76 None None] MFA Rules not processed for user `6c6d72bf582542e589f547d810ad9f69`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:32.581891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0cf76877-aa22-4557-aa7a-de5fd4961a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:32.655686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1346/2696] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:32.667074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310e69-7146-4596-99c6-faf4e5cd47cb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:32.667605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310e69-7146-4596-99c6-faf4e5cd47cb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:32.667714 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310e69-7146-4596-99c6-faf4e5cd47cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:32.685773 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-62310e69-7146-4596-99c6-faf4e5cd47cb None None] MFA Rules not processed for user `6c6d72bf582542e589f547d810ad9f69`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:32.687002 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-62310e69-7146-4596-99c6-faf4e5cd47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:32.694541 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1351/2697] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:32.707963 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76877-aa22-4557-aa7a-de5fd4961a76 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:32.709616 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0cf76877-aa22-4557-aa7a-de5fd4961a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:32.786503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf76877-aa22-4557-aa7a-de5fd4961a76 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:32.791932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6c141-f31e-40f5-a567-23f4b0f1390f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904a4e5f54e642eda58c90930b5858f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:32.792610 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c141-f31e-40f5-a567-23f4b0f1390f service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:32.792892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c141-f31e-40f5-a567-23f4b0f1390f service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:32.793174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6c141-f31e-40f5-a567-23f4b0f1390f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:32.800988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6c141-f31e-40f5-a567-23f4b0f1390f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:32.802576 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6c141-f31e-40f5-a567-23f4b0f1390f service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:32.812063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1347/2698] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:41.879792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62310e69-7146-4596-99c6-faf4e5cd47cb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:41.881235 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-62310e69-7146-4596-99c6-faf4e5cd47cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:41.894708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62310e69-7146-4596-99c6-faf4e5cd47cb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:41.899404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:41.900910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:41.901191 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:41.901464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] PATH_INFO: `/v3/users/c427336d3ef64aff80a4c9969fe24046` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:41.902675 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c427336d3ef64aff80a4c9969fe24046)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:41.904605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:41.948404 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c427336d3ef64aff80a4c9969fe24046'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:41.955240 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c427336d3ef64aff80a4c9969fe24046'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:41.961957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c427336d3ef64aff80a4c9969fe24046'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:41.974445 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c427336d3ef64aff80a4c9969fe24046'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:41.975084 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c427336d3ef64aff80a4c9969fe24046'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:41.980971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1352/2699] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:41 2022] DELETE /identity/v3/users/c427336d3ef64aff80a4c9969fe24046 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:41.985610 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae94be5-c4b4-4b75-b6c9-a207a5079014 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:41.986086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae94be5-c4b4-4b75-b6c9-a207a5079014 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:41.986184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae94be5-c4b4-4b75-b6c9-a207a5079014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:42.005694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8ae94be5-c4b4-4b75-b6c9-a207a5079014 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:42.007126 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8ae94be5-c4b4-4b75-b6c9-a207a5079014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:42.066303 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1348/2700] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:47:42.076748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:42.078156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:42.131957 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d5f49-f83d-4351-a37e-83ca93ac764c admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:42.136097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b74a67-0eeb-499f-bc59-0e0d5f3f7693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:42.136750 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b74a67-0eeb-499f-bc59-0e0d5f3f7693 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:42.137024 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b74a67-0eeb-499f-bc59-0e0d5f3f7693 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:42.137369 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b74a67-0eeb-499f-bc59-0e0d5f3f7693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:42.145884 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b74a67-0eeb-499f-bc59-0e0d5f3f7693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:42.147297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b74a67-0eeb-499f-bc59-0e0d5f3f7693 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:42.156809 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1353/2701] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:42.407814 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae94be5-c4b4-4b75-b6c9-a207a5079014 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:42.409359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8ae94be5-c4b4-4b75-b6c9-a207a5079014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:42.422376 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae94be5-c4b4-4b75-b6c9-a207a5079014 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:42.428093 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:42.429003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:42.429286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:42.429610 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] PATH_INFO: `/v3/projects/abf125799c7146a9b5c1e0abc67322e7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:42.430822 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf125799c7146a9b5c1e0abc67322e7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:42.433425 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:42.479057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf125799c7146a9b5c1e0abc67322e7', 'request_id': 'req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.485078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf125799c7146a9b5c1e0abc67322e7', 'request_id': 'req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.490283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf125799c7146a9b5c1e0abc67322e7', 'request_id': 'req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.502300 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] The token cache is being invalidate because project abf125799c7146a9b5c1e0abc67322e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:42.502581 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.503192 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.504723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1349/2702] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:42 2022] DELETE /identity/v3/projects/abf125799c7146a9b5c1e0abc67322e7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:42.508643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b74a67-0eeb-499f-bc59-0e0d5f3f7693 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:42.518168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b74a67-0eeb-499f-bc59-0e0d5f3f7693 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:42.572209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:42.573107 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:42.573385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:42.573656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] PATH_INFO: `/v3/users/327a5829c39c4f97be7a780862f69931` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:42.574853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=327a5829c39c4f97be7a780862f69931)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:42.576803 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:42.620692 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327a5829c39c4f97be7a780862f69931'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.631748 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327a5829c39c4f97be7a780862f69931'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.639278 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327a5829c39c4f97be7a780862f69931'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.651093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327a5829c39c4f97be7a780862f69931'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.651797 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-9fccb5a2-c7aa-4053-a6da-e365d1bc74cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327a5829c39c4f97be7a780862f69931'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:42.657562 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1354/2703] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:42 2022] DELETE /identity/v3/users/327a5829c39c4f97be7a780862f69931 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:43.014819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.016249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:43.029637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80a92f-ac2e-415b-9e23-9cee1ae0268e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.086628 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.088032 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.088308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.088604 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] PATH_INFO: `/v3/projects/7b9a107c9e774cc89e91d0c77134f185` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.089855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9a107c9e774cc89e91d0c77134f185)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.091828 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.136399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9a107c9e774cc89e91d0c77134f185', 'request_id': 'req-f168c0ac-50d0-4920-b619-56f681edffa2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:43.142366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9a107c9e774cc89e91d0c77134f185', 'request_id': 'req-f168c0ac-50d0-4920-b619-56f681edffa2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:43.147906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9a107c9e774cc89e91d0c77134f185', 'request_id': 'req-f168c0ac-50d0-4920-b619-56f681edffa2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:43.161189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] The token cache is being invalidate because project 7b9a107c9e774cc89e91d0c77134f185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:43.161470 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:43.162075 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f168c0ac-50d0-4920-b619-56f681edffa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:43.163570 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1350/2704] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:43 2022] DELETE /identity/v3/projects/7b9a107c9e774cc89e91d0c77134f185 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:43.169382 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82156a-7978-4f82-8b25-6b89d59d1e75 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.169837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82156a-7978-4f82-8b25-6b89d59d1e75 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.169950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82156a-7978-4f82-8b25-6b89d59d1e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.188705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-ef82156a-7978-4f82-8b25-6b89d59d1e75 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:43.189886 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ef82156a-7978-4f82-8b25-6b89d59d1e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:43.245614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1355/2705] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:43.253983 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e1f0f-1d85-49c4-9dfa-426036053949 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.254271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e1f0f-1d85-49c4-9dfa-426036053949 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.254549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e1f0f-1d85-49c4-9dfa-426036053949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.272795 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-792e1f0f-1d85-49c4-9dfa-426036053949 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:43.273973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-792e1f0f-1d85-49c4-9dfa-426036053949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:43.282324 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1351/2706] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:47:43.286374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82156a-7978-4f82-8b25-6b89d59d1e75 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.295699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82156a-7978-4f82-8b25-6b89d59d1e75 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.300192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5606e26-6205-4779-ae2c-76f54c593015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.300819 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5606e26-6205-4779-ae2c-76f54c593015 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.301099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5606e26-6205-4779-ae2c-76f54c593015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.301370 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5606e26-6205-4779-ae2c-76f54c593015 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.302108 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5606e26-6205-4779-ae2c-76f54c593015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:47:43.302407 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5606e26-6205-4779-ae2c-76f54c593015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.303990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5606e26-6205-4779-ae2c-76f54c593015 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.315664 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1356/2707] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:47:43.319667 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e1f0f-1d85-49c4-9dfa-426036053949 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.329846 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e1f0f-1d85-49c4-9dfa-426036053949 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.334759 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1de6a-ed7c-47a1-937e-ab3c6b02365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.335415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1de6a-ed7c-47a1-937e-ab3c6b02365d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.335701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1de6a-ed7c-47a1-937e-ab3c6b02365d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.335977 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1de6a-ed7c-47a1-937e-ab3c6b02365d admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.336729 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1de6a-ed7c-47a1-937e-ab3c6b02365d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.339722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1de6a-ed7c-47a1-937e-ab3c6b02365d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.370294 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1352/2708] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:43 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:43.371849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5606e26-6205-4779-ae2c-76f54c593015 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.382219 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5606e26-6205-4779-ae2c-76f54c593015 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.443967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855224d-871a-4c54-bece-5e09416a6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.444704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855224d-871a-4c54-bece-5e09416a6a5d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.445001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855224d-871a-4c54-bece-5e09416a6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.445280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855224d-871a-4c54-bece-5e09416a6a5d admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.446004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855224d-871a-4c54-bece-5e09416a6a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.448772 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855224d-871a-4c54-bece-5e09416a6a5d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.475410 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1357/2709] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:43 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:43.476959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1de6a-ed7c-47a1-937e-ab3c6b02365d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.488598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1de6a-ed7c-47a1-937e-ab3c6b02365d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.493553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc226a-51e7-42ec-9224-7e454300c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.494273 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc226a-51e7-42ec-9224-7e454300c59e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.494579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc226a-51e7-42ec-9224-7e454300c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.494840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc226a-51e7-42ec-9224-7e454300c59e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.495893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc226a-51e7-42ec-9224-7e454300c59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.497936 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc226a-51e7-42ec-9224-7e454300c59e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.510674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1353/2710] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:43.514535 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855224d-871a-4c54-bece-5e09416a6a5d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.526129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855224d-871a-4c54-bece-5e09416a6a5d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.531106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269899f-ae50-4150-83a1-bf00c299b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.531914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269899f-ae50-4150-83a1-bf00c299b456 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.532209 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269899f-ae50-4150-83a1-bf00c299b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.532522 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269899f-ae50-4150-83a1-bf00c299b456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.533269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269899f-ae50-4150-83a1-bf00c299b456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.535076 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269899f-ae50-4150-83a1-bf00c299b456 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.548092 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1358/2711] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:43.550776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc226a-51e7-42ec-9224-7e454300c59e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.563466 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc226a-51e7-42ec-9224-7e454300c59e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.569092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4253c-e4ee-4506-a051-aff37c60ec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.570124 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4253c-e4ee-4506-a051-aff37c60ec4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.570276 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4253c-e4ee-4506-a051-aff37c60ec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.570509 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4253c-e4ee-4506-a051-aff37c60ec4b admin admin] PATH_INFO: `/v3/projects/093b13e5806342b59d6262829064a50f/users/046552c071aa44aa9fa090e14400e6e7/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.588714 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4253c-e4ee-4506-a051-aff37c60ec4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=093b13e5806342b59d6262829064a50f, user_id=046552c071aa44aa9fa090e14400e6e7, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.591767 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4253c-e4ee-4506-a051-aff37c60ec4b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.607008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1354/2712] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:43 2022] PUT /identity/v3/projects/093b13e5806342b59d6262829064a50f/users/046552c071aa44aa9fa090e14400e6e7/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:47:43.617665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be169158-58e7-4d91-b20e-abd6e8ac1e7b None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.618418 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be169158-58e7-4d91-b20e-abd6e8ac1e7b None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.619380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be169158-58e7-4d91-b20e-abd6e8ac1e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.651149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-be169158-58e7-4d91-b20e-abd6e8ac1e7b None None] MFA Rules not processed for user `046552c071aa44aa9fa090e14400e6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:43.652482 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-be169158-58e7-4d91-b20e-abd6e8ac1e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:43.720449 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1359/2713] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:43.724529 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4253c-e4ee-4506-a051-aff37c60ec4b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.788207 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4253c-e4ee-4506-a051-aff37c60ec4b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.793577 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505040a1-ee2b-462c-a155-7f81146df14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.794231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505040a1-ee2b-462c-a155-7f81146df14a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.794516 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505040a1-ee2b-462c-a155-7f81146df14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.794794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505040a1-ee2b-462c-a155-7f81146df14a admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.795507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505040a1-ee2b-462c-a155-7f81146df14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.797450 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505040a1-ee2b-462c-a155-7f81146df14a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.826031 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1355/2714] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:43 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:43.829789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be169158-58e7-4d91-b20e-abd6e8ac1e7b None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.841963 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be169158-58e7-4d91-b20e-abd6e8ac1e7b None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.918104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085ff02-4480-44c9-a0f0-0cd2d6e2a712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.918792 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085ff02-4480-44c9-a0f0-0cd2d6e2a712 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.919075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085ff02-4480-44c9-a0f0-0cd2d6e2a712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.919354 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085ff02-4480-44c9-a0f0-0cd2d6e2a712 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.920080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085ff02-4480-44c9-a0f0-0cd2d6e2a712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.922060 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085ff02-4480-44c9-a0f0-0cd2d6e2a712 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.952849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1360/2715] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:43 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:43.956836 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505040a1-ee2b-462c-a155-7f81146df14a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:43.970377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505040a1-ee2b-462c-a155-7f81146df14a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:43.977033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bd1c-e43d-4844-9763-6d659a74df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:43.978160 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bd1c-e43d-4844-9763-6d659a74df18 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:43.978593 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bd1c-e43d-4844-9763-6d659a74df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:43.979054 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bd1c-e43d-4844-9763-6d659a74df18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:43.980103 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90bd1c-e43d-4844-9763-6d659a74df18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:43.982024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90bd1c-e43d-4844-9763-6d659a74df18 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:43.998792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1356/2716] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:43.999569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085ff02-4480-44c9-a0f0-0cd2d6e2a712 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:44.013812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085ff02-4480-44c9-a0f0-0cd2d6e2a712 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:44.021964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7dd1f-e1c9-4c55-b745-373940aa59fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:44.022853 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7dd1f-e1c9-4c55-b745-373940aa59fc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.023593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7dd1f-e1c9-4c55-b745-373940aa59fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.023878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7dd1f-e1c9-4c55-b745-373940aa59fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.024686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7dd1f-e1c9-4c55-b745-373940aa59fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:44.026967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7dd1f-e1c9-4c55-b745-373940aa59fc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:44.040383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1361/2717] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:44.044209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bd1c-e43d-4844-9763-6d659a74df18 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:44.060114 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bd1c-e43d-4844-9763-6d659a74df18 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:44.065108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b18de8-21a6-4d08-86dc-01ee0f1913b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:44.066020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b18de8-21a6-4d08-86dc-01ee0f1913b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.066430 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b18de8-21a6-4d08-86dc-01ee0f1913b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.066709 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b18de8-21a6-4d08-86dc-01ee0f1913b0 admin admin] PATH_INFO: `/v3/projects/4ce9aec8e1f2474e9c4ea51049adf059/users/ae168d6ef5b84e1792aad5b83a9696d5/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.083772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b18de8-21a6-4d08-86dc-01ee0f1913b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce9aec8e1f2474e9c4ea51049adf059, user_id=ae168d6ef5b84e1792aad5b83a9696d5, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:44.086484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b18de8-21a6-4d08-86dc-01ee0f1913b0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:44.112626 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1357/2718] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:44 2022] PUT /identity/v3/projects/4ce9aec8e1f2474e9c4ea51049adf059/users/ae168d6ef5b84e1792aad5b83a9696d5/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:47:44.115415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bec9f-3672-4bf3-8550-9eaa84a290fa None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.115699 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bec9f-3672-4bf3-8550-9eaa84a290fa None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.115982 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bec9f-3672-4bf3-8550-9eaa84a290fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.143674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3f2bec9f-3672-4bf3-8550-9eaa84a290fa None None] MFA Rules not processed for user `ae168d6ef5b84e1792aad5b83a9696d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:44.144930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3f2bec9f-3672-4bf3-8550-9eaa84a290fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:44.208058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1362/2719] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:44.212310 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b18de8-21a6-4d08-86dc-01ee0f1913b0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:44.273157 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b18de8-21a6-4d08-86dc-01ee0f1913b0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:44.278414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be315-0dc7-4601-aa08-20135de78f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:44.279058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be315-0dc7-4601-aa08-20135de78f09 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.279339 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be315-0dc7-4601-aa08-20135de78f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.279613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be315-0dc7-4601-aa08-20135de78f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.280315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be315-0dc7-4601-aa08-20135de78f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:44.282231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be315-0dc7-4601-aa08-20135de78f09 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:44.310285 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1358/2720] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:44 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:47:44.313994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bec9f-3672-4bf3-8550-9eaa84a290fa None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:44.325297 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bec9f-3672-4bf3-8550-9eaa84a290fa None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:44.381389 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbed775-2e1b-4c16-8864-422e701dad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:44.382058 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbed775-2e1b-4c16-8864-422e701dad10 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.382346 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbed775-2e1b-4c16-8864-422e701dad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.382620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbed775-2e1b-4c16-8864-422e701dad10 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.383330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbed775-2e1b-4c16-8864-422e701dad10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:44.385327 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbed775-2e1b-4c16-8864-422e701dad10 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:44.406651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1363/2721] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:44 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:44.410622 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be315-0dc7-4601-aa08-20135de78f09 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:44.421322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be315-0dc7-4601-aa08-20135de78f09 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:44.426047 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fbb34-eb40-4062-a25a-43a109966fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:44.426706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fbb34-eb40-4062-a25a-43a109966fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.426990 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fbb34-eb40-4062-a25a-43a109966fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.427262 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fbb34-eb40-4062-a25a-43a109966fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.428006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fbb34-eb40-4062-a25a-43a109966fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:44.429637 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fbb34-eb40-4062-a25a-43a109966fc1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:44.442077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1359/2722] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:47:44.446652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbed775-2e1b-4c16-8864-422e701dad10 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:44.456595 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbed775-2e1b-4c16-8864-422e701dad10 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:44.461349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9555e-74b2-4df5-b0eb-66f078186083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:44.462227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9555e-74b2-4df5-b0eb-66f078186083 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.463037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9555e-74b2-4df5-b0eb-66f078186083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.463313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9555e-74b2-4df5-b0eb-66f078186083 admin admin] PATH_INFO: `/v3/projects/080bf6fe816a4590b5000d63a37040f9/users/efb221f3066744af967a8f8c443062e0/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.477900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9555e-74b2-4df5-b0eb-66f078186083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080bf6fe816a4590b5000d63a37040f9, user_id=efb221f3066744af967a8f8c443062e0, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:44.481135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9555e-74b2-4df5-b0eb-66f078186083 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:44.494450 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1364/2723] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:44 2022] PUT /identity/v3/projects/080bf6fe816a4590b5000d63a37040f9/users/efb221f3066744af967a8f8c443062e0/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:47:44.498397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fbb34-eb40-4062-a25a-43a109966fc1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:44.508687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fbb34-eb40-4062-a25a-43a109966fc1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:44.565026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a99a1-dded-43fe-91d7-e9e076707ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:44.565715 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a99a1-dded-43fe-91d7-e9e076707ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.565999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a99a1-dded-43fe-91d7-e9e076707ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.566284 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a99a1-dded-43fe-91d7-e9e076707ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.567011 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a99a1-dded-43fe-91d7-e9e076707ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:44.569050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a99a1-dded-43fe-91d7-e9e076707ff2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:44.584740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1360/2724] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:44.585766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9555e-74b2-4df5-b0eb-66f078186083 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:44.596429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9555e-74b2-4df5-b0eb-66f078186083 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:44.602252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b220c6-88b9-4512-841d-e9048c8e8af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:44.603826 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b220c6-88b9-4512-841d-e9048c8e8af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.604109 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b220c6-88b9-4512-841d-e9048c8e8af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.604412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b220c6-88b9-4512-841d-e9048c8e8af1 admin admin] PATH_INFO: `/v3/projects/080bf6fe816a4590b5000d63a37040f9/users/efb221f3066744af967a8f8c443062e0/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.606548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b220c6-88b9-4512-841d-e9048c8e8af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=080bf6fe816a4590b5000d63a37040f9, user_id=efb221f3066744af967a8f8c443062e0, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:44.609415 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b220c6-88b9-4512-841d-e9048c8e8af1 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:44.620077 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1365/2725] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:44 2022] PUT /identity/v3/projects/080bf6fe816a4590b5000d63a37040f9/users/efb221f3066744af967a8f8c443062e0/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:44.630414 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf62b2-766e-41dc-937a-27cf8f0c9c78 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.631260 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf62b2-766e-41dc-937a-27cf8f0c9c78 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.631260 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf62b2-766e-41dc-937a-27cf8f0c9c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.657761 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-42cf62b2-766e-41dc-937a-27cf8f0c9c78 None None] MFA Rules not processed for user `efb221f3066744af967a8f8c443062e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:44.658992 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-42cf62b2-766e-41dc-937a-27cf8f0c9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:44.739786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1361/2726] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:44.749503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b220c6-88b9-4512-841d-e9048c8e8af1 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:44.751503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-93b220c6-88b9-4512-841d-e9048c8e8af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:44.818110 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b220c6-88b9-4512-841d-e9048c8e8af1 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:44.823697 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7ae72-92f2-4cca-b1e7-134cd6b01c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:44.824363 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ae72-92f2-4cca-b1e7-134cd6b01c56 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:44.824661 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ae72-92f2-4cca-b1e7-134cd6b01c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:44.824937 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7ae72-92f2-4cca-b1e7-134cd6b01c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:44.835298 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7ae72-92f2-4cca-b1e7-134cd6b01c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:44.837059 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7ae72-92f2-4cca-b1e7-134cd6b01c56 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:44.849213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1366/2727] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:45.348284 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf62b2-766e-41dc-937a-27cf8f0c9c78 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:45.349837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-42cf62b2-766e-41dc-937a-27cf8f0c9c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:45.364409 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf62b2-766e-41dc-937a-27cf8f0c9c78 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:45.368215 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99cc85-92d1-4de5-bc23-53a865bc2680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:45.369446 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99cc85-92d1-4de5-bc23-53a865bc2680 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:45.369725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99cc85-92d1-4de5-bc23-53a865bc2680 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:45.369999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99cc85-92d1-4de5-bc23-53a865bc2680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:45.429512 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99cc85-92d1-4de5-bc23-53a865bc2680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:45.430984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99cc85-92d1-4de5-bc23-53a865bc2680 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:45.441617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1362/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:45.671527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399598da-f6a7-4080-be96-491680fa951a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:45.672720 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399598da-f6a7-4080-be96-491680fa951a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:45.673100 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399598da-f6a7-4080-be96-491680fa951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:45.693421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-399598da-f6a7-4080-be96-491680fa951a None None] MFA Rules not processed for user `042a422ead5c48f1a428028abe9e419b`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:45.694751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-399598da-f6a7-4080-be96-491680fa951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:45.758655 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1367/2729] 10.222.0.15 () {58 vars in 967 bytes} [Mon Feb 7 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:45.811775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99cc85-92d1-4de5-bc23-53a865bc2680 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:45.813416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5c99cc85-92d1-4de5-bc23-53a865bc2680 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:45.881644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99cc85-92d1-4de5-bc23-53a865bc2680 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:45.886764 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b34ad-a378-4c78-b6d9-9828aea9592c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2074fd021729416ea1c9b596d0bb892b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:45.887327 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b34ad-a378-4c78-b6d9-9828aea9592c service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:45.887614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b34ad-a378-4c78-b6d9-9828aea9592c service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:45.887889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b34ad-a378-4c78-b6d9-9828aea9592c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:45.895909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b34ad-a378-4c78-b6d9-9828aea9592c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:45.897519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b34ad-a378-4c78-b6d9-9828aea9592c service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:45.906085 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1363/2730] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Feb 7 02:47:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 07 02:47:49.614839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399598da-f6a7-4080-be96-491680fa951a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:49.636781 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399598da-f6a7-4080-be96-491680fa951a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:49.640869 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1e815-7e33-4c2a-aef0-1b3127928a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:49.641812 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1e815-7e33-4c2a-aef0-1b3127928a7c service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:49.642288 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1e815-7e33-4c2a-aef0-1b3127928a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:49.642911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1e815-7e33-4c2a-aef0-1b3127928a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:49.737310 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1e815-7e33-4c2a-aef0-1b3127928a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:49.738859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1e815-7e33-4c2a-aef0-1b3127928a7c service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:49.747986 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1368/2731] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:51.801382 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b34ad-a378-4c78-b6d9-9828aea9592c service swift] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:51.862891 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b34ad-a378-4c78-b6d9-9828aea9592c service swift] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:51.867417 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:51.868271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:51.868601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:51.868872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] PATH_INFO: `/v3/users/046552c071aa44aa9fa090e14400e6e7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:51.870058 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=046552c071aa44aa9fa090e14400e6e7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:51.872021 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:51.918998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046552c071aa44aa9fa090e14400e6e7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:51.928614 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046552c071aa44aa9fa090e14400e6e7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:51.943102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046552c071aa44aa9fa090e14400e6e7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:51.943926 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046552c071aa44aa9fa090e14400e6e7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:51.952665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046552c071aa44aa9fa090e14400e6e7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:51.960006 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1364/2732] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:51 2022] DELETE /identity/v3/users/046552c071aa44aa9fa090e14400e6e7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:51.965623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56cca6-7d2e-4881-863b-47fcea03a3ee None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:51.966703 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56cca6-7d2e-4881-863b-47fcea03a3ee None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:51.967106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56cca6-7d2e-4881-863b-47fcea03a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:51.987786 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-be56cca6-7d2e-4881-863b-47fcea03a3ee None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:51.989032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-be56cca6-7d2e-4881-863b-47fcea03a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:52.052711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1369/2733] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:52.058827 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:52.061089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:52.123796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3396eb-d34f-4354-8c04-0ed4a8f110ef admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:52.127488 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4a20b-f06a-4025-89eb-8d4e771c9146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:52.128143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4a20b-f06a-4025-89eb-8d4e771c9146 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:52.128591 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4a20b-f06a-4025-89eb-8d4e771c9146 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:52.128872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4a20b-f06a-4025-89eb-8d4e771c9146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:52.139050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4a20b-f06a-4025-89eb-8d4e771c9146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:52.140528 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4a20b-f06a-4025-89eb-8d4e771c9146 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:52.151128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1365/2734] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:47:52.433048 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56cca6-7d2e-4881-863b-47fcea03a3ee None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:52.435072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-be56cca6-7d2e-4881-863b-47fcea03a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:52.452154 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56cca6-7d2e-4881-863b-47fcea03a3ee None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:52.457867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:52.458614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:52.459072 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:52.459495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] PATH_INFO: `/v3/projects/093b13e5806342b59d6262829064a50f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:52.461027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=093b13e5806342b59d6262829064a50f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:52.463913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:52.519208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093b13e5806342b59d6262829064a50f', 'request_id': 'req-13c655c2-cabc-4f56-9c05-d36071def38e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.527292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093b13e5806342b59d6262829064a50f', 'request_id': 'req-13c655c2-cabc-4f56-9c05-d36071def38e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.535510 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093b13e5806342b59d6262829064a50f', 'request_id': 'req-13c655c2-cabc-4f56-9c05-d36071def38e'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.546221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] The token cache is being invalidate because project 093b13e5806342b59d6262829064a50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:52.546597 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.547267 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.549220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1370/2735] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:52 2022] DELETE /identity/v3/projects/093b13e5806342b59d6262829064a50f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:52.552939 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4a20b-f06a-4025-89eb-8d4e771c9146 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:52.566579 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4a20b-f06a-4025-89eb-8d4e771c9146 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:52.658050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:52.658959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:52.659238 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:52.659518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] PATH_INFO: `/v3/users/ae168d6ef5b84e1792aad5b83a9696d5` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:52.661028 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae168d6ef5b84e1792aad5b83a9696d5)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:52.664185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:52.753255 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae168d6ef5b84e1792aad5b83a9696d5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.767352 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae168d6ef5b84e1792aad5b83a9696d5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.781474 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae168d6ef5b84e1792aad5b83a9696d5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.788792 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae168d6ef5b84e1792aad5b83a9696d5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.802907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae168d6ef5b84e1792aad5b83a9696d5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:52.810322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1366/2736] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:52 2022] DELETE /identity/v3/users/ae168d6ef5b84e1792aad5b83a9696d5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:53.135257 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:53.137832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:53.157922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c655c2-cabc-4f56-9c05-d36071def38e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:53.163077 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:53.164681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:53.225559 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:53.226586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:53.226865 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:53.227283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] PATH_INFO: `/v3/projects/4ce9aec8e1f2474e9c4ea51049adf059` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:53.229365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce9aec8e1f2474e9c4ea51049adf059)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:53.231368 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:53.243930 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fe387-a5f2-4725-b9d8-f41cf44af43e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:53.248987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:53.249962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:53.250366 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:53.250654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] PATH_INFO: `/v3/users/48a9098a2f7d4bff894abe78308107be` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:53.251973 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a9098a2f7d4bff894abe78308107be)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:53.254002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:53.284179 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce9aec8e1f2474e9c4ea51049adf059', 'request_id': 'req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.291920 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce9aec8e1f2474e9c4ea51049adf059', 'request_id': 'req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.299153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce9aec8e1f2474e9c4ea51049adf059', 'request_id': 'req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.307914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a9098a2f7d4bff894abe78308107be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.311735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] The token cache is being invalidate because project 4ce9aec8e1f2474e9c4ea51049adf059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:53.312049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.312827 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.314757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1371/2737] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:53 2022] DELETE /identity/v3/projects/4ce9aec8e1f2474e9c4ea51049adf059 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:53.318443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:53.319931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:53.321597 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a9098a2f7d4bff894abe78308107be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.335314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a9098a2f7d4bff894abe78308107be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.335984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a9098a2f7d4bff894abe78308107be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.345950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a9098a2f7d4bff894abe78308107be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.352158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1367/2738] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:53 2022] DELETE /identity/v3/users/48a9098a2f7d4bff894abe78308107be => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:53.383095 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0bbb0-c287-4bcf-8180-cf626e9bd7a0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:53.437460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:53.438316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:53.438590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:53.438858 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] PATH_INFO: `/v3/users/efb221f3066744af967a8f8c443062e0` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:53.440061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb221f3066744af967a8f8c443062e0)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:53.441994 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:53.489291 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb221f3066744af967a8f8c443062e0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.496524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb221f3066744af967a8f8c443062e0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.504930 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb221f3066744af967a8f8c443062e0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.518855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb221f3066744af967a8f8c443062e0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.519674 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb221f3066744af967a8f8c443062e0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.529874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:53.530063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1372/2739] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:53 2022] DELETE /identity/v3/users/efb221f3066744af967a8f8c443062e0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:53.530152 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:53.543317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f295e-d42e-444e-a839-546c0d927999 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:53.600564 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:53.601412 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:53.601690 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:53.601962 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] PATH_INFO: `/v3/projects/72eb261400104c0b9b2132c91f25845b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:53.604653 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72eb261400104c0b9b2132c91f25845b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:53.606543 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:53.660787 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72eb261400104c0b9b2132c91f25845b', 'request_id': 'req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.667546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72eb261400104c0b9b2132c91f25845b', 'request_id': 'req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.675857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72eb261400104c0b9b2132c91f25845b', 'request_id': 'req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.689623 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] The token cache is being invalidate because project 72eb261400104c0b9b2132c91f25845b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:53.689816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.690784 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.695390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1368/2740] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:53 2022] DELETE /identity/v3/projects/72eb261400104c0b9b2132c91f25845b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:47:53.697807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:53.699765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:53.713029 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c498693-46b9-41f2-8cb7-3f010645c60e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:53.766894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:53.767751 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:53.768028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:53.768299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] PATH_INFO: `/v3/users/0b604e7e16514b8b8b5a1a1ae91cfc9f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:53.769519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b604e7e16514b8b8b5a1a1ae91cfc9f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:53.771423 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:53.813400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:53.815218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:53.830929 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea1b0c-0b6e-4fc3-aa4a-0acd5f24eb7e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:53.831093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b604e7e16514b8b8b5a1a1ae91cfc9f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.836426 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:53.838063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:53.838465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:53.838839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] PATH_INFO: `/v3/projects/080bf6fe816a4590b5000d63a37040f9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:53.840279 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080bf6fe816a4590b5000d63a37040f9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:53.842621 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:53.844385 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b604e7e16514b8b8b5a1a1ae91cfc9f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.856837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b604e7e16514b8b8b5a1a1ae91cfc9f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.869293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b604e7e16514b8b8b5a1a1ae91cfc9f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.870414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ee937c07-0d27-4d7b-a5af-b1e2afb21a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b604e7e16514b8b8b5a1a1ae91cfc9f'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.876395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1373/2741] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:47:53 2022] DELETE /identity/v3/users/0b604e7e16514b8b8b5a1a1ae91cfc9f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:53.892686 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080bf6fe816a4590b5000d63a37040f9', 'request_id': 'req-f7e455b6-2159-4a69-8397-aeaf5c8d7665'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.898809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080bf6fe816a4590b5000d63a37040f9', 'request_id': 'req-f7e455b6-2159-4a69-8397-aeaf5c8d7665'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.905363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080bf6fe816a4590b5000d63a37040f9', 'request_id': 'req-f7e455b6-2159-4a69-8397-aeaf5c8d7665'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.917582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] The token cache is being invalidate because project 080bf6fe816a4590b5000d63a37040f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:53.917870 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.918511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f7e455b6-2159-4a69-8397-aeaf5c8d7665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:53.920097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1369/2742] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:53 2022] DELETE /identity/v3/projects/080bf6fe816a4590b5000d63a37040f9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:47:53.927301 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13547064-cf64-4cec-bc3a-80cf5a2c4c26 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:53.927585 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13547064-cf64-4cec-bc3a-80cf5a2c4c26 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:53.927909 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13547064-cf64-4cec-bc3a-80cf5a2c4c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:53.948044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-13547064-cf64-4cec-bc3a-80cf5a2c4c26 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:53.949296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-13547064-cf64-4cec-bc3a-80cf5a2c4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:54.011939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1374/2743] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:54.021427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c95600-c23b-4503-aacd-0a31219f661a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.021706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c95600-c23b-4503-aacd-0a31219f661a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.021987 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c95600-c23b-4503-aacd-0a31219f661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.040756 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-18c95600-c23b-4503-aacd-0a31219f661a None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:54.042252 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-18c95600-c23b-4503-aacd-0a31219f661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:54.045822 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13547064-cf64-4cec-bc3a-80cf5a2c4c26 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.047306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-13547064-cf64-4cec-bc3a-80cf5a2c4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:54.052158 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1370/2744] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:54.057172 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c95600-c23b-4503-aacd-0a31219f661a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.060892 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13547064-cf64-4cec-bc3a-80cf5a2c4c26 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.065807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.066713 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.066840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c95600-c23b-4503-aacd-0a31219f661a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.066991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.067263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] PATH_INFO: `/v3/projects/dcf6edc7c4d445b1a55be6028e3dccbc` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.068627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf6edc7c4d445b1a55be6028e3dccbc)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.070532 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.074292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e38c36-e3be-45ae-8cb2-2be622c144e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.075210 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e38c36-e3be-45ae-8cb2-2be622c144e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.075657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e38c36-e3be-45ae-8cb2-2be622c144e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.076015 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e38c36-e3be-45ae-8cb2-2be622c144e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.076874 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e38c36-e3be-45ae-8cb2-2be622c144e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:47:54.077237 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e38c36-e3be-45ae-8cb2-2be622c144e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.078892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e38c36-e3be-45ae-8cb2-2be622c144e2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.090595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1371/2745] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:47:54.094725 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e38c36-e3be-45ae-8cb2-2be622c144e2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.104160 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e38c36-e3be-45ae-8cb2-2be622c144e2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.117142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf6edc7c4d445b1a55be6028e3dccbc', 'request_id': 'req-ff22e00a-79ff-40f1-bd66-f913ea81488a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:54.123734 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf6edc7c4d445b1a55be6028e3dccbc', 'request_id': 'req-ff22e00a-79ff-40f1-bd66-f913ea81488a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:54.130968 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf6edc7c4d445b1a55be6028e3dccbc', 'request_id': 'req-ff22e00a-79ff-40f1-bd66-f913ea81488a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:54.142129 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] The token cache is being invalidate because project dcf6edc7c4d445b1a55be6028e3dccbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:47:54.143037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:54.143788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:47:54.145598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1375/2746] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:47:54 2022] DELETE /identity/v3/projects/dcf6edc7c4d445b1a55be6028e3dccbc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:54.161357 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7cc3-63ef-49ba-9c5e-b8f13ab8326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.162204 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7cc3-63ef-49ba-9c5e-b8f13ab8326b admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.162608 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7cc3-63ef-49ba-9c5e-b8f13ab8326b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.162984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7cc3-63ef-49ba-9c5e-b8f13ab8326b admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.163809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e7cc3-63ef-49ba-9c5e-b8f13ab8326b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.165919 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e7cc3-63ef-49ba-9c5e-b8f13ab8326b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.198415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1372/2747] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:54 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:54.202633 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.204217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:54.217648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22e00a-79ff-40f1-bd66-f913ea81488a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.276003 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1b6ea-b31f-48de-ab24-e21c8365a915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.276623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1b6ea-b31f-48de-ab24-e21c8365a915 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.276906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1b6ea-b31f-48de-ab24-e21c8365a915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.277178 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1b6ea-b31f-48de-ab24-e21c8365a915 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.277881 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1b6ea-b31f-48de-ab24-e21c8365a915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.279820 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1b6ea-b31f-48de-ab24-e21c8365a915 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.300309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1376/2748] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:54 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:54.304664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7cc3-63ef-49ba-9c5e-b8f13ab8326b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.315925 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7cc3-63ef-49ba-9c5e-b8f13ab8326b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.321022 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e355e-0cdb-48ed-9301-f6f79e3d6c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.322862 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e355e-0cdb-48ed-9301-f6f79e3d6c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.323212 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e355e-0cdb-48ed-9301-f6f79e3d6c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.323552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e355e-0cdb-48ed-9301-f6f79e3d6c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.324416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e355e-0cdb-48ed-9301-f6f79e3d6c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.326221 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e355e-0cdb-48ed-9301-f6f79e3d6c89 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.338415 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1373/2749] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:54.342526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1b6ea-b31f-48de-ab24-e21c8365a915 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.353741 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1b6ea-b31f-48de-ab24-e21c8365a915 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.358670 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0261e-cff0-43f2-b7ea-4c82c5cb56aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.359589 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0261e-cff0-43f2-b7ea-4c82c5cb56aa admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.359876 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0261e-cff0-43f2-b7ea-4c82c5cb56aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.360148 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0261e-cff0-43f2-b7ea-4c82c5cb56aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.360923 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0261e-cff0-43f2-b7ea-4c82c5cb56aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.362543 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0261e-cff0-43f2-b7ea-4c82c5cb56aa admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.374174 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1377/2750] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:54.378034 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e355e-0cdb-48ed-9301-f6f79e3d6c89 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.388898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e355e-0cdb-48ed-9301-f6f79e3d6c89 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.393531 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fccd9-f45c-4061-a3f9-bb6c7555cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.394405 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fccd9-f45c-4061-a3f9-bb6c7555cdd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.394683 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fccd9-f45c-4061-a3f9-bb6c7555cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.394955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fccd9-f45c-4061-a3f9-bb6c7555cdd7 admin admin] PATH_INFO: `/v3/projects/135f74316d2c426e963c1b9930e69d68/users/6c10daa695e545a4a17948a25661f627/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.409605 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fccd9-f45c-4061-a3f9-bb6c7555cdd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135f74316d2c426e963c1b9930e69d68, user_id=6c10daa695e545a4a17948a25661f627, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.412213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fccd9-f45c-4061-a3f9-bb6c7555cdd7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.425582 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1374/2751] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:54 2022] PUT /identity/v3/projects/135f74316d2c426e963c1b9930e69d68/users/6c10daa695e545a4a17948a25661f627/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:54.436367 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1ab16-f9af-41b1-a117-15f062968b8a None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.436667 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1ab16-f9af-41b1-a117-15f062968b8a None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.436945 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1ab16-f9af-41b1-a117-15f062968b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.463488 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-7ba1ab16-f9af-41b1-a117-15f062968b8a None None] MFA Rules not processed for user `6c10daa695e545a4a17948a25661f627`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:54.464837 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7ba1ab16-f9af-41b1-a117-15f062968b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:54.518850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fccd9-f45c-4061-a3f9-bb6c7555cdd7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.520633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-627fccd9-f45c-4061-a3f9-bb6c7555cdd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:54.525654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1378/2752] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:54.530102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1ab16-f9af-41b1-a117-15f062968b8a None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.576796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fccd9-f45c-4061-a3f9-bb6c7555cdd7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.581223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad58536-62ee-4f26-b4e5-b10ba8c4db36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.581858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad58536-62ee-4f26-b4e5-b10ba8c4db36 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.583658 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad58536-62ee-4f26-b4e5-b10ba8c4db36 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.583943 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad58536-62ee-4f26-b4e5-b10ba8c4db36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.585887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6ad58536-62ee-4f26-b4e5-b10ba8c4db36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:54.589908 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1ab16-f9af-41b1-a117-15f062968b8a None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.594807 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f95f3-f731-4994-9a6b-69de42bb2371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.595460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f95f3-f731-4994-9a6b-69de42bb2371 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.595739 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f95f3-f731-4994-9a6b-69de42bb2371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.596014 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f95f3-f731-4994-9a6b-69de42bb2371 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.597151 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f95f3-f731-4994-9a6b-69de42bb2371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.598658 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f95f3-f731-4994-9a6b-69de42bb2371 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.632421 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1379/2753] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:47:54 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:54.637062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f95f3-f731-4994-9a6b-69de42bb2371 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.666766 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad58536-62ee-4f26-b4e5-b10ba8c4db36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.668274 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad58536-62ee-4f26-b4e5-b10ba8c4db36 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.685283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1375/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:47:54.703630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f95f3-f731-4994-9a6b-69de42bb2371 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.708769 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304069f-d277-48e9-8f2b-95df6e0c1d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.709502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304069f-d277-48e9-8f2b-95df6e0c1d7d admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.709778 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304069f-d277-48e9-8f2b-95df6e0c1d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.710044 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304069f-d277-48e9-8f2b-95df6e0c1d7d admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.710735 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304069f-d277-48e9-8f2b-95df6e0c1d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.713250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304069f-d277-48e9-8f2b-95df6e0c1d7d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.732961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1380/2755] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:47:54 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:47:54.737202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad58536-62ee-4f26-b4e5-b10ba8c4db36 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.748086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad58536-62ee-4f26-b4e5-b10ba8c4db36 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.753890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f37c3-f39f-49bd-a559-5fe0773ab7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.754696 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f37c3-f39f-49bd-a559-5fe0773ab7dd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.754984 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f37c3-f39f-49bd-a559-5fe0773ab7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.755256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f37c3-f39f-49bd-a559-5fe0773ab7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.756229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f37c3-f39f-49bd-a559-5fe0773ab7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.758008 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f37c3-f39f-49bd-a559-5fe0773ab7dd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.770265 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1376/2756] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:54.775557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304069f-d277-48e9-8f2b-95df6e0c1d7d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.786117 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304069f-d277-48e9-8f2b-95df6e0c1d7d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.790991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f57c6-442f-48ee-97af-fc676265681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.791855 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f57c6-442f-48ee-97af-fc676265681b admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.792134 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f57c6-442f-48ee-97af-fc676265681b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.792438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f57c6-442f-48ee-97af-fc676265681b admin admin] PATH_INFO: `/v3/projects/99509588676f4b418ede4162e6c52e95/users/714b71be93be488d8fe339f0d175c71a/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.807456 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f57c6-442f-48ee-97af-fc676265681b admin admin] RBAC: Authorizing `identity:create_grant(project_id=99509588676f4b418ede4162e6c52e95, user_id=714b71be93be488d8fe339f0d175c71a, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.810165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f57c6-442f-48ee-97af-fc676265681b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.825232 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1381/2757] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:54 2022] PUT /identity/v3/projects/99509588676f4b418ede4162e6c52e95/users/714b71be93be488d8fe339f0d175c71a/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:54.829251 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f37c3-f39f-49bd-a559-5fe0773ab7dd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.845508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f37c3-f39f-49bd-a559-5fe0773ab7dd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.904170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a9638-41e6-41f2-924f-be82de7a4717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.904861 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a9638-41e6-41f2-924f-be82de7a4717 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.905143 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a9638-41e6-41f2-924f-be82de7a4717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.905416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a9638-41e6-41f2-924f-be82de7a4717 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.906142 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a9638-41e6-41f2-924f-be82de7a4717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.907706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a9638-41e6-41f2-924f-be82de7a4717 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.917397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1377/2758] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:47:54.921405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f57c6-442f-48ee-97af-fc676265681b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:54.931730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f57c6-442f-48ee-97af-fc676265681b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:54.936252 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d44fb3-77a6-47e5-a548-bcc7ce65cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:54.937138 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d44fb3-77a6-47e5-a548-bcc7ce65cf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.937411 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d44fb3-77a6-47e5-a548-bcc7ce65cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.937680 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d44fb3-77a6-47e5-a548-bcc7ce65cf08 admin admin] PATH_INFO: `/v3/projects/99509588676f4b418ede4162e6c52e95/users/714b71be93be488d8fe339f0d175c71a/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.939614 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d44fb3-77a6-47e5-a548-bcc7ce65cf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99509588676f4b418ede4162e6c52e95, user_id=714b71be93be488d8fe339f0d175c71a, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:54.942221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d44fb3-77a6-47e5-a548-bcc7ce65cf08 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:54.952939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1382/2759] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:47:54 2022] PUT /identity/v3/projects/99509588676f4b418ede4162e6c52e95/users/714b71be93be488d8fe339f0d175c71a/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:47:54.962988 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2696-b192-4a1e-9944-417f57cc0151 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:54.963278 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2696-b192-4a1e-9944-417f57cc0151 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:54.963549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2696-b192-4a1e-9944-417f57cc0151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:54.989092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-814b2696-b192-4a1e-9944-417f57cc0151 None None] MFA Rules not processed for user `714b71be93be488d8fe339f0d175c71a`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:54.990268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-814b2696-b192-4a1e-9944-417f57cc0151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:55.055118 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1378/2760] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:47:55.065206 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d44fb3-77a6-47e5-a548-bcc7ce65cf08 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:47:55.066874 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-95d44fb3-77a6-47e5-a548-bcc7ce65cf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:55.122222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d44fb3-77a6-47e5-a548-bcc7ce65cf08 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:47:55.126412 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eceadc-0212-4d74-a32e-ffe1837e791b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:47:55.127046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eceadc-0212-4d74-a32e-ffe1837e791b service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:55.127323 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eceadc-0212-4d74-a32e-ffe1837e791b service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:55.127596 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eceadc-0212-4d74-a32e-ffe1837e791b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:55.183775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eceadc-0212-4d74-a32e-ffe1837e791b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:47:55.185251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eceadc-0212-4d74-a32e-ffe1837e791b service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:47:55.193973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1383/2761] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:47:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:47:59.171552 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681c5dd-ffe3-4086-a3c7-c2247d256d76 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:47:59.172061 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681c5dd-ffe3-4086-a3c7-c2247d256d76 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:47:59.172169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681c5dd-ffe3-4086-a3c7-c2247d256d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:47:59.189089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9681c5dd-ffe3-4086-a3c7-c2247d256d76 None None] MFA Rules not processed for user `6c6d72bf582542e589f547d810ad9f69`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:47:59.190259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9681c5dd-ffe3-4086-a3c7-c2247d256d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:47:59.242678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1379/2762] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:48:00.802243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eceadc-0212-4d74-a32e-ffe1837e791b service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:00.867149 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eceadc-0212-4d74-a32e-ffe1837e791b service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:00.872519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:00.873461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:00.873961 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:00.874329 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] PATH_INFO: `/v3/users/6c10daa695e545a4a17948a25661f627` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:00.876293 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c10daa695e545a4a17948a25661f627)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:00.878343 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:00.933767 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c10daa695e545a4a17948a25661f627'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:00.940992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c10daa695e545a4a17948a25661f627'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:00.948987 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c10daa695e545a4a17948a25661f627'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:00.960181 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c10daa695e545a4a17948a25661f627'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:00.960868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c10daa695e545a4a17948a25661f627'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:00.967172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1384/2763] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:48:00 2022] DELETE /identity/v3/users/6c10daa695e545a4a17948a25661f627 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:00.971730 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aea0af-6738-403e-95b7-ffbb490051bd None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:00.972230 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aea0af-6738-403e-95b7-ffbb490051bd None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:00.972487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aea0af-6738-403e-95b7-ffbb490051bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:00.991697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-58aea0af-6738-403e-95b7-ffbb490051bd None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:48:00.993066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-58aea0af-6738-403e-95b7-ffbb490051bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:01.054364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1380/2764] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:48:01.064273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:01.065925 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:01.122128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85255a17-042e-4bee-a5ae-8d94d88b55ae admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:01.126578 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880e206-ea5e-4abd-bf3b-a456db76f42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:01.127218 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880e206-ea5e-4abd-bf3b-a456db76f42b service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:01.127519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880e206-ea5e-4abd-bf3b-a456db76f42b service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:01.128296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880e206-ea5e-4abd-bf3b-a456db76f42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:01.138167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880e206-ea5e-4abd-bf3b-a456db76f42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:01.139583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880e206-ea5e-4abd-bf3b-a456db76f42b service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:01.149037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1385/2765] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:48:01.441166 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aea0af-6738-403e-95b7-ffbb490051bd None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:01.443816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-58aea0af-6738-403e-95b7-ffbb490051bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:01.465313 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aea0af-6738-403e-95b7-ffbb490051bd None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:01.470247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:01.471097 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:01.471372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:01.471641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] PATH_INFO: `/v3/projects/135f74316d2c426e963c1b9930e69d68` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:01.472865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=135f74316d2c426e963c1b9930e69d68)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:01.476091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d101c-3c45-4348-8e5b-8b4b8445dcbd None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:01.476335 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d101c-3c45-4348-8e5b-8b4b8445dcbd None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:01.476730 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d101c-3c45-4348-8e5b-8b4b8445dcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:01.490348 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:01.501338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-dd6d101c-3c45-4348-8e5b-8b4b8445dcbd None None] MFA Rules not processed for user `f182c5215d37423da1a00cbb98757957`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:48:01.502897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dd6d101c-3c45-4348-8e5b-8b4b8445dcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:01.544292 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135f74316d2c426e963c1b9930e69d68', 'request_id': 'req-415d9fc3-aee2-47a4-937e-67e8bd0433ed'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.551194 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135f74316d2c426e963c1b9930e69d68', 'request_id': 'req-415d9fc3-aee2-47a4-937e-67e8bd0433ed'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.557282 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135f74316d2c426e963c1b9930e69d68', 'request_id': 'req-415d9fc3-aee2-47a4-937e-67e8bd0433ed'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.570358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] The token cache is being invalidate because project 135f74316d2c426e963c1b9930e69d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:48:01.570655 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.572233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.578214 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1386/2766] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:48:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:48:01.578399 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1381/2767] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:48:01 2022] DELETE /identity/v3/projects/135f74316d2c426e963c1b9930e69d68 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:01.578526 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d101c-3c45-4348-8e5b-8b4b8445dcbd None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:01.591454 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d101c-3c45-4348-8e5b-8b4b8445dcbd None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:01.652763 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:01.653636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:01.653916 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:01.654189 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] PATH_INFO: `/v3/users/714b71be93be488d8fe339f0d175c71a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:01.655434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714b71be93be488d8fe339f0d175c71a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:01.657504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:01.704188 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714b71be93be488d8fe339f0d175c71a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.710935 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714b71be93be488d8fe339f0d175c71a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.717814 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714b71be93be488d8fe339f0d175c71a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.729620 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714b71be93be488d8fe339f0d175c71a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.730340 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714b71be93be488d8fe339f0d175c71a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:01.736359 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1387/2768] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:48:01 2022] DELETE /identity/v3/users/714b71be93be488d8fe339f0d175c71a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:02.034189 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.035768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:02.070225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d9fc3-aee2-47a4-937e-67e8bd0433ed admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.100285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.101897 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:02.146796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.147968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.148136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.148812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] PATH_INFO: `/v3/projects/99509588676f4b418ede4162e6c52e95` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.150299 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99509588676f4b418ede4162e6c52e95)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:02.152741 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:02.166105 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415244d-e060-4d0b-ab44-ce839c51b5c5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.171864 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26564108-55bf-41c5-9f15-5334639a23d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.172651 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26564108-55bf-41c5-9f15-5334639a23d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.173046 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26564108-55bf-41c5-9f15-5334639a23d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.173460 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26564108-55bf-41c5-9f15-5334639a23d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.175592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-26564108-55bf-41c5-9f15-5334639a23d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:02.188165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26564108-55bf-41c5-9f15-5334639a23d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:02.189738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26564108-55bf-41c5-9f15-5334639a23d2 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:02.199062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1388/2769] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:48:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:48:02.224518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99509588676f4b418ede4162e6c52e95', 'request_id': 'req-1668bc47-0682-4fd9-a386-553df2c88860'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:02.232595 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99509588676f4b418ede4162e6c52e95', 'request_id': 'req-1668bc47-0682-4fd9-a386-553df2c88860'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:02.237865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99509588676f4b418ede4162e6c52e95', 'request_id': 'req-1668bc47-0682-4fd9-a386-553df2c88860'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:02.250443 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] The token cache is being invalidate because project 99509588676f4b418ede4162e6c52e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:48:02.250751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:02.251363 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1668bc47-0682-4fd9-a386-553df2c88860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:02.253045 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1382/2770] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:48:02 2022] DELETE /identity/v3/projects/99509588676f4b418ede4162e6c52e95 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:02.260432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e491d-e5a4-4335-b37b-57f964477c89 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.260716 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e491d-e5a4-4335-b37b-57f964477c89 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.260999 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e491d-e5a4-4335-b37b-57f964477c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.279122 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-225e491d-e5a4-4335-b37b-57f964477c89 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:48:02.280304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-225e491d-e5a4-4335-b37b-57f964477c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:02.339306 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1389/2771] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:48:02.348000 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666430d8-f265-4809-b0fd-44d4385f0742 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.348295 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666430d8-f265-4809-b0fd-44d4385f0742 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.348610 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666430d8-f265-4809-b0fd-44d4385f0742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.367541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-666430d8-f265-4809-b0fd-44d4385f0742 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:48:02.368773 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-666430d8-f265-4809-b0fd-44d4385f0742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:02.376698 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1383/2772] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:48:02.381121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e491d-e5a4-4335-b37b-57f964477c89 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.390805 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e491d-e5a4-4335-b37b-57f964477c89 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.395414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a8cd5-505d-439d-9272-91783e9f9ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.396067 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a8cd5-505d-439d-9272-91783e9f9ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.396362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a8cd5-505d-439d-9272-91783e9f9ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.396646 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a8cd5-505d-439d-9272-91783e9f9ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.397396 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a8cd5-505d-439d-9272-91783e9f9ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:48:02.397698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a8cd5-505d-439d-9272-91783e9f9ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:02.399793 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a8cd5-505d-439d-9272-91783e9f9ebc admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:02.414462 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1390/2773] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:48:02.416176 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666430d8-f265-4809-b0fd-44d4385f0742 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.425959 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666430d8-f265-4809-b0fd-44d4385f0742 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.430533 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcded-0275-4de6-9b7f-02aa58372907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.431171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcded-0275-4de6-9b7f-02aa58372907 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.431449 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcded-0275-4de6-9b7f-02aa58372907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.431719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dcded-0275-4de6-9b7f-02aa58372907 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.432503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dcded-0275-4de6-9b7f-02aa58372907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:02.434398 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dcded-0275-4de6-9b7f-02aa58372907 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:02.462565 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1384/2774] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:48:02 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:48:02.463785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a8cd5-505d-439d-9272-91783e9f9ebc admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.473973 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a8cd5-505d-439d-9272-91783e9f9ebc admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.529365 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f80c6-d4fe-4051-97ae-62d0f5f418b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.530045 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f80c6-d4fe-4051-97ae-62d0f5f418b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.530325 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f80c6-d4fe-4051-97ae-62d0f5f418b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.530711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f80c6-d4fe-4051-97ae-62d0f5f418b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.531299 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f80c6-d4fe-4051-97ae-62d0f5f418b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:02.533256 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f80c6-d4fe-4051-97ae-62d0f5f418b8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:02.555259 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1391/2775] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:48:02 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:48:02.559569 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcded-0275-4de6-9b7f-02aa58372907 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.570723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dcded-0275-4de6-9b7f-02aa58372907 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.575907 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0966bb-346f-44e0-876f-c88ec8531928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.576890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0966bb-346f-44e0-876f-c88ec8531928 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.577239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0966bb-346f-44e0-876f-c88ec8531928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.577613 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0966bb-346f-44e0-876f-c88ec8531928 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.578497 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0966bb-346f-44e0-876f-c88ec8531928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:02.580372 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0966bb-346f-44e0-876f-c88ec8531928 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:02.593760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1385/2776] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:48:02.597894 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f80c6-d4fe-4051-97ae-62d0f5f418b8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.608414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f80c6-d4fe-4051-97ae-62d0f5f418b8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.613180 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c27a5-89b5-490a-914b-ebba8e8e1623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.613842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c27a5-89b5-490a-914b-ebba8e8e1623 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.614121 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c27a5-89b5-490a-914b-ebba8e8e1623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.614397 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c27a5-89b5-490a-914b-ebba8e8e1623 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.615158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c27a5-89b5-490a-914b-ebba8e8e1623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:02.616784 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c27a5-89b5-490a-914b-ebba8e8e1623 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:02.627185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1392/2777] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:48:02.631586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0966bb-346f-44e0-876f-c88ec8531928 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.643856 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0966bb-346f-44e0-876f-c88ec8531928 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.648876 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ed26d-48e4-4d87-b7d9-c89d5ec317ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.650751 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ed26d-48e4-4d87-b7d9-c89d5ec317ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.651029 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ed26d-48e4-4d87-b7d9-c89d5ec317ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.651305 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ed26d-48e4-4d87-b7d9-c89d5ec317ca admin admin] PATH_INFO: `/v3/projects/af93a4b3ba884530ba1c4e6563478c42/users/c7b49aa035984e9294aad8feb83adf87/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.668003 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ed26d-48e4-4d87-b7d9-c89d5ec317ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=af93a4b3ba884530ba1c4e6563478c42, user_id=c7b49aa035984e9294aad8feb83adf87, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:02.670838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ed26d-48e4-4d87-b7d9-c89d5ec317ca admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:02.686955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1386/2778] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:48:02 2022] PUT /identity/v3/projects/af93a4b3ba884530ba1c4e6563478c42/users/c7b49aa035984e9294aad8feb83adf87/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:02.698112 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b3aef-b723-4adf-a319-ebd37a51266d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.698524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b3aef-b723-4adf-a319-ebd37a51266d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.698871 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b3aef-b723-4adf-a319-ebd37a51266d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.728818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-703b3aef-b723-4adf-a319-ebd37a51266d None None] MFA Rules not processed for user `c7b49aa035984e9294aad8feb83adf87`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:48:02.730030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-703b3aef-b723-4adf-a319-ebd37a51266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:02.806264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1393/2779] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:48:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:48:02.815734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ed26d-48e4-4d87-b7d9-c89d5ec317ca admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.817509 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-170ed26d-48e4-4d87-b7d9-c89d5ec317ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:02.880461 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ed26d-48e4-4d87-b7d9-c89d5ec317ca admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.881097 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b3aef-b723-4adf-a319-ebd37a51266d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:02.882544 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-703b3aef-b723-4adf-a319-ebd37a51266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:02.885169 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773620af-029b-41df-98bf-8e7dde1e083e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.885890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773620af-029b-41df-98bf-8e7dde1e083e service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.886217 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773620af-029b-41df-98bf-8e7dde1e083e service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.886586 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773620af-029b-41df-98bf-8e7dde1e083e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.907001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773620af-029b-41df-98bf-8e7dde1e083e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:02.908650 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773620af-029b-41df-98bf-8e7dde1e083e service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:02.928768 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1387/2780] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:48:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:48:02.979028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b3aef-b723-4adf-a319-ebd37a51266d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:02.984115 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8da77-a3da-428e-89a5-152133f6e217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:02.985639 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8da77-a3da-428e-89a5-152133f6e217 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:02.985939 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8da77-a3da-428e-89a5-152133f6e217 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:02.986220 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8da77-a3da-428e-89a5-152133f6e217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:02.989313 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0de8da77-a3da-428e-89a5-152133f6e217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:03.072775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8da77-a3da-428e-89a5-152133f6e217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:03.074349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8da77-a3da-428e-89a5-152133f6e217 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:03.087902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1394/2781] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:48:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 07 02:48:14.371777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773620af-029b-41df-98bf-8e7dde1e083e service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:14.381208 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773620af-029b-41df-98bf-8e7dde1e083e service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:14.386014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:14.386701 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:14.386971 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:14.387246 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:14.389057 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:14.452826 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:14.454250 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:14.463813 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1388/2782] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:48:18.292698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583f4d-2a07-4254-9352-1379731692cb None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:18.293251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583f4d-2a07-4254-9352-1379731692cb None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:18.293251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583f4d-2a07-4254-9352-1379731692cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:18.311405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-95583f4d-2a07-4254-9352-1379731692cb None None] MFA Rules not processed for user `6c6d72bf582542e589f547d810ad9f69`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:48:18.312803 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-95583f4d-2a07-4254-9352-1379731692cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:18.368447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1395/2783] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:48:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:48:22.044661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:22.046140 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:22.058471 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadeac49-26e9-48d3-87bb-fc39bea6a7a4 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:22.063041 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:22.063892 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:22.064170 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:22.064485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] PATH_INFO: `/v3/users/b22380932c4e49df935c4424dbe0dc84` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:22.065672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22380932c4e49df935c4424dbe0dc84)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:22.067556 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:22.140209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22380932c4e49df935c4424dbe0dc84'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.146950 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22380932c4e49df935c4424dbe0dc84'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.159487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22380932c4e49df935c4424dbe0dc84'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.160249 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22380932c4e49df935c4424dbe0dc84'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.168033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22380932c4e49df935c4424dbe0dc84'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.175331 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1389/2784] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:48:22 2022] DELETE /identity/v3/users/b22380932c4e49df935c4424dbe0dc84 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:22.361852 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583f4d-2a07-4254-9352-1379731692cb None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:22.377500 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583f4d-2a07-4254-9352-1379731692cb None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:22.464984 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:22.466011 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:22.466406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:22.466775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] PATH_INFO: `/v3/projects/21a9d29f17224774a232218b99165d32` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:22.468153 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a9d29f17224774a232218b99165d32)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:22.470223 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:22.523248 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a9d29f17224774a232218b99165d32', 'request_id': 'req-7f73899a-cf15-411f-91d7-45d8e67484b0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.531783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a9d29f17224774a232218b99165d32', 'request_id': 'req-7f73899a-cf15-411f-91d7-45d8e67484b0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.544035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a9d29f17224774a232218b99165d32', 'request_id': 'req-7f73899a-cf15-411f-91d7-45d8e67484b0'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.567504 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] The token cache is being invalidate because project 21a9d29f17224774a232218b99165d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:48:22.567862 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.570732 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.572970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1396/2785] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:48:22 2022] DELETE /identity/v3/projects/21a9d29f17224774a232218b99165d32 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:22.577134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:22.578955 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:22.609221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:22.611035 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:22.634915 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35bc95-1b4d-419c-bd03-7165292d6f8c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:22.709641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:22.711527 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:22.712225 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:22.712618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] PATH_INFO: `/v3/users/b20673af8c274f63afedc4561704448c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:22.713217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73899a-cf15-411f-91d7-45d8e67484b0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:22.718013 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20673af8c274f63afedc4561704448c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:22.718609 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:22.719569 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:22.719913 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:22.721124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] PATH_INFO: `/v3/users/c7b49aa035984e9294aad8feb83adf87` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:22.721913 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:22.722593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b49aa035984e9294aad8feb83adf87)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:22.724663 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:22.791127 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b49aa035984e9294aad8feb83adf87'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.792838 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20673af8c274f63afedc4561704448c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.799905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b49aa035984e9294aad8feb83adf87'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.801407 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20673af8c274f63afedc4561704448c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.806983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b49aa035984e9294aad8feb83adf87'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.814528 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20673af8c274f63afedc4561704448c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.815248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20673af8c274f63afedc4561704448c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.818978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b49aa035984e9294aad8feb83adf87'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.820292 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-5cc247bc-b7ba-4a10-bb88-e19e50d2dc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b49aa035984e9294aad8feb83adf87'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.824174 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20673af8c274f63afedc4561704448c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:22.830203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1397/2786] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:48:22 2022] DELETE /identity/v3/users/c7b49aa035984e9294aad8feb83adf87 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:22.831053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1390/2787] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:48:22 2022] DELETE /identity/v3/users/b20673af8c274f63afedc4561704448c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:22.831932 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e2ed8-0d0e-4155-b3b9-f8897556ed39 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:22.832243 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e2ed8-0d0e-4155-b3b9-f8897556ed39 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:22.832602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e2ed8-0d0e-4155-b3b9-f8897556ed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:22.852728 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3d3e2ed8-0d0e-4155-b3b9-f8897556ed39 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:48:22.853936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3d3e2ed8-0d0e-4155-b3b9-f8897556ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:22.931727 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1398/2788] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:48:22.941038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:22.942776 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:23.003175 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac4c55-4fc6-45b3-acc7-f904507d598d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:23.007314 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a4a53-dc6f-4ae1-b7b7-f8eb9741b905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:23.008537 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a4a53-dc6f-4ae1-b7b7-f8eb9741b905 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:23.008859 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a4a53-dc6f-4ae1-b7b7-f8eb9741b905 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:23.009144 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a4a53-dc6f-4ae1-b7b7-f8eb9741b905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:23.018816 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a4a53-dc6f-4ae1-b7b7-f8eb9741b905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:23.020306 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a4a53-dc6f-4ae1-b7b7-f8eb9741b905 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:23.024974 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e2ed8-0d0e-4155-b3b9-f8897556ed39 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:23.026538 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3d3e2ed8-0d0e-4155-b3b9-f8897556ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:23.030952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1391/2789] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:48:23.045001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e2ed8-0d0e-4155-b3b9-f8897556ed39 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:23.050264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:23.051200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:23.051602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:23.052037 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] PATH_INFO: `/v3/projects/dda52da4a9244401ae747dcfb7534442` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:23.053684 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda52da4a9244401ae747dcfb7534442)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:23.056859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:23.104920 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda52da4a9244401ae747dcfb7534442', 'request_id': 'req-1e3f1bd1-7572-4072-a3e4-26e8451e069a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.111391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda52da4a9244401ae747dcfb7534442', 'request_id': 'req-1e3f1bd1-7572-4072-a3e4-26e8451e069a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.119434 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda52da4a9244401ae747dcfb7534442', 'request_id': 'req-1e3f1bd1-7572-4072-a3e4-26e8451e069a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.130402 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] The token cache is being invalidate because project dda52da4a9244401ae747dcfb7534442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:48:23.130696 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.131419 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.133605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1399/2790] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:48:23 2022] DELETE /identity/v3/projects/dda52da4a9244401ae747dcfb7534442 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:48:23.390884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a4a53-dc6f-4ae1-b7b7-f8eb9741b905 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:23.393572 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-626a4a53-dc6f-4ae1-b7b7-f8eb9741b905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:23.407109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a4a53-dc6f-4ae1-b7b7-f8eb9741b905 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:23.465705 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:23.466562 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:23.466846 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:23.467125 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] PATH_INFO: `/v3/projects/af93a4b3ba884530ba1c4e6563478c42` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:23.468337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af93a4b3ba884530ba1c4e6563478c42)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:23.470255 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:23.517050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af93a4b3ba884530ba1c4e6563478c42', 'request_id': 'req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.523081 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af93a4b3ba884530ba1c4e6563478c42', 'request_id': 'req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.528389 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af93a4b3ba884530ba1c4e6563478c42', 'request_id': 'req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.540660 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] The token cache is being invalidate because project af93a4b3ba884530ba1c4e6563478c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:48:23.540944 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.541554 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-874eba31-7b82-40f6-ad60-f5f8ec1c38d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:48:23.543079 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1392/2791] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:48:23 2022] DELETE /identity/v3/projects/af93a4b3ba884530ba1c4e6563478c42 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:48:25.423098 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:25.424562 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:25.479615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1bd1-7572-4072-a3e4-26e8451e069a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:25.525545 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:25.526184 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:25.526461 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:25.528157 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:25.530062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:25.590192 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:25.591632 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:25.601165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1400/2792] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:48:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:48:38.930226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920aa36-68d2-4c3c-8ec8-b22bdd564272 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:38.931377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920aa36-68d2-4c3c-8ec8-b22bdd564272 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:38.931377 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920aa36-68d2-4c3c-8ec8-b22bdd564272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:38.949063 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d920aa36-68d2-4c3c-8ec8-b22bdd564272 None None] MFA Rules not processed for user `6c6d72bf582542e589f547d810ad9f69`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:48:38.950264 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d920aa36-68d2-4c3c-8ec8-b22bdd564272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:39.002459 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1393/2793] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:48:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:48:39.956959 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:48:39.958377 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:40.024187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c848f9e-12c1-4193-8a84-6a2614554939 service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:48:40.029142 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f84497-3aa0-4701-a719-38bbc89c4868 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06b37b8f23946ebbb5083a877274ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:48:40.029779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f84497-3aa0-4701-a719-38bbc89c4868 service placement] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:48:40.030062 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f84497-3aa0-4701-a719-38bbc89c4868 service placement] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:48:40.030334 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f84497-3aa0-4701-a719-38bbc89c4868 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:48:40.032202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-84f84497-3aa0-4701-a719-38bbc89c4868 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:48:40.043560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f84497-3aa0-4701-a719-38bbc89c4868 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:48:40.045182 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f84497-3aa0-4701-a719-38bbc89c4868 service placement] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:48:40.054975 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1401/2794] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:48:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:49:16.616847 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920aa36-68d2-4c3c-8ec8-b22bdd564272 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:16.618839 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d920aa36-68d2-4c3c-8ec8-b22bdd564272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:16.682800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920aa36-68d2-4c3c-8ec8-b22bdd564272 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:16.687354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:16.688239 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:16.688547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:16.688823 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] PATH_INFO: `/v3/users/6c6d72bf582542e589f547d810ad9f69` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:16.690024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6d72bf582542e589f547d810ad9f69)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:16.691931 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:16.734503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6d72bf582542e589f547d810ad9f69'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:16.741138 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6d72bf582542e589f547d810ad9f69'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:16.752857 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6d72bf582542e589f547d810ad9f69'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:16.753508 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6d72bf582542e589f547d810ad9f69'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:16.760636 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2845e5c2-fd39-4e9c-85c7-dc42f473ed9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6d72bf582542e589f547d810ad9f69'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:16.766349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1394/2795] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:49:16 2022] DELETE /identity/v3/users/6c6d72bf582542e589f547d810ad9f69 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:16.930507 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f84497-3aa0-4701-a719-38bbc89c4868 service placement] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:16.949168 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f84497-3aa0-4701-a719-38bbc89c4868 service placement] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:17.003758 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:17.004669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.004950 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.005228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] PATH_INFO: `/v3/projects/32ffab3576ce4eaeb40893e31d8af4d7` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.006413 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ffab3576ce4eaeb40893e31d8af4d7)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:17.008360 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:17.051949 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ffab3576ce4eaeb40893e31d8af4d7', 'request_id': 'req-c53cda11-638f-4fa4-b29b-88fb0585695b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:17.058400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ffab3576ce4eaeb40893e31d8af4d7', 'request_id': 'req-c53cda11-638f-4fa4-b29b-88fb0585695b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:17.065296 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ffab3576ce4eaeb40893e31d8af4d7', 'request_id': 'req-c53cda11-638f-4fa4-b29b-88fb0585695b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:17.075298 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] The token cache is being invalidate because project 32ffab3576ce4eaeb40893e31d8af4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:49:17.075583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:17.076204 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c53cda11-638f-4fa4-b29b-88fb0585695b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:17.077756 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1402/2796] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:49:16 2022] DELETE /identity/v3/projects/32ffab3576ce4eaeb40893e31d8af4d7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:49:17.083574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c4f2-1b53-4488-83da-ae48aa14848e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.083864 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c4f2-1b53-4488-83da-ae48aa14848e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.084163 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c4f2-1b53-4488-83da-ae48aa14848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.102111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-63b0c4f2-1b53-4488-83da-ae48aa14848e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:17.103812 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-63b0c4f2-1b53-4488-83da-ae48aa14848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:17.160878 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1395/2797] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:17.169012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470190e-8b39-432e-a763-e2140e0596f5 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.169295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470190e-8b39-432e-a763-e2140e0596f5 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.169568 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470190e-8b39-432e-a763-e2140e0596f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.188055 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-3470190e-8b39-432e-a763-e2140e0596f5 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:17.189205 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-3470190e-8b39-432e-a763-e2140e0596f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:17.197242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1403/2798] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:17.201184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0c4f2-1b53-4488-83da-ae48aa14848e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:17.210587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0c4f2-1b53-4488-83da-ae48aa14848e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:17.215601 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d662-c158-41bb-b461-a65ddfe6de80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:17.216243 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d662-c158-41bb-b461-a65ddfe6de80 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.216548 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d662-c158-41bb-b461-a65ddfe6de80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.216819 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1d662-c158-41bb-b461-a65ddfe6de80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.217546 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1d662-c158-41bb-b461-a65ddfe6de80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:49:17.217851 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1d662-c158-41bb-b461-a65ddfe6de80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:17.219420 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1d662-c158-41bb-b461-a65ddfe6de80 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:17.231359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1396/2799] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:49:17.235203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470190e-8b39-432e-a763-e2140e0596f5 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:17.244082 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470190e-8b39-432e-a763-e2140e0596f5 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:17.248842 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e429c1-a6cb-4200-a183-e1e2c51b3c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:17.249473 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e429c1-a6cb-4200-a183-e1e2c51b3c05 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.249749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e429c1-a6cb-4200-a183-e1e2c51b3c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.250668 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e429c1-a6cb-4200-a183-e1e2c51b3c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.251398 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e429c1-a6cb-4200-a183-e1e2c51b3c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:17.253336 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e429c1-a6cb-4200-a183-e1e2c51b3c05 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:17.278251 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1404/2800] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:49:17 2022] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:17.282112 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d662-c158-41bb-b461-a65ddfe6de80 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:17.292724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1d662-c158-41bb-b461-a65ddfe6de80 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:17.346418 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf3fb0-4c09-4f1c-94d0-4850b14b395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:17.347109 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf3fb0-4c09-4f1c-94d0-4850b14b395a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.347476 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf3fb0-4c09-4f1c-94d0-4850b14b395a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.347765 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf3fb0-4c09-4f1c-94d0-4850b14b395a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.348510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf3fb0-4c09-4f1c-94d0-4850b14b395a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:17.350392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf3fb0-4c09-4f1c-94d0-4850b14b395a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:17.369682 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1397/2801] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:49:17 2022] POST /identity/v3/users => generated 302 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:17.373912 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e429c1-a6cb-4200-a183-e1e2c51b3c05 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:17.383875 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e429c1-a6cb-4200-a183-e1e2c51b3c05 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:17.388519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd2d6-c01e-4767-a59e-0356f2e39b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:17.389163 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd2d6-c01e-4767-a59e-0356f2e39b6d admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.389443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd2d6-c01e-4767-a59e-0356f2e39b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.389719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd2d6-c01e-4767-a59e-0356f2e39b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.390443 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cd2d6-c01e-4767-a59e-0356f2e39b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:17.392032 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cd2d6-c01e-4767-a59e-0356f2e39b6d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:17.402678 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1405/2802] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:17.406428 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf3fb0-4c09-4f1c-94d0-4850b14b395a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:17.416750 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf3fb0-4c09-4f1c-94d0-4850b14b395a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:17.421422 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a357f-e2c1-46a1-bb07-7c289a254e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:17.422096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a357f-e2c1-46a1-bb07-7c289a254e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.422374 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a357f-e2c1-46a1-bb07-7c289a254e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.422672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a357f-e2c1-46a1-bb07-7c289a254e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.423397 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a357f-e2c1-46a1-bb07-7c289a254e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:17.425022 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a357f-e2c1-46a1-bb07-7c289a254e95 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:17.434762 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1398/2803] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:17.438669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd2d6-c01e-4767-a59e-0356f2e39b6d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:17.448567 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd2d6-c01e-4767-a59e-0356f2e39b6d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:17.453135 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba232949-59a1-4550-821a-10458b90fe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:17.453983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba232949-59a1-4550-821a-10458b90fe3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.454263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba232949-59a1-4550-821a-10458b90fe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.454534 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba232949-59a1-4550-821a-10458b90fe3e admin admin] PATH_INFO: `/v3/projects/de81e69c344f44fe8b29143980c6e59f/users/97d3a882485740bcbc039b5392b4e6c8/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.469290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba232949-59a1-4550-821a-10458b90fe3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de81e69c344f44fe8b29143980c6e59f, user_id=97d3a882485740bcbc039b5392b4e6c8, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:17.471900 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba232949-59a1-4550-821a-10458b90fe3e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:17.485290 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1406/2804] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:49:17 2022] PUT /identity/v3/projects/de81e69c344f44fe8b29143980c6e59f/users/97d3a882485740bcbc039b5392b4e6c8/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:49:17.490304 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9524-63e9-4ff9-8ea8-dda877c65f39 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.490590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9524-63e9-4ff9-8ea8-dda877c65f39 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.490865 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9524-63e9-4ff9-8ea8-dda877c65f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.507933 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a24b9524-63e9-4ff9-8ea8-dda877c65f39 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:17.509139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a24b9524-63e9-4ff9-8ea8-dda877c65f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:17.564089 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1399/2805] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:49:17.574558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba232949-59a1-4550-821a-10458b90fe3e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:17.576207 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-ba232949-59a1-4550-821a-10458b90fe3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:17.630446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba232949-59a1-4550-821a-10458b90fe3e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:17.634850 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422fd74-e8f7-4446-a753-c48e12d78ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:17.635502 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422fd74-e8f7-4446-a753-c48e12d78ceb service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:17.635779 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422fd74-e8f7-4446-a753-c48e12d78ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:17.636049 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422fd74-e8f7-4446-a753-c48e12d78ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:17.645104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422fd74-e8f7-4446-a753-c48e12d78ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:17.646536 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422fd74-e8f7-4446-a753-c48e12d78ceb service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:17.656294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1407/2806] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:49:18.242936 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191c76-9947-4a82-bcf6-33d3e1438429 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:18.243815 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191c76-9947-4a82-bcf6-33d3e1438429 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:18.244083 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191c76-9947-4a82-bcf6-33d3e1438429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:18.270427 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fc191c76-9947-4a82-bcf6-33d3e1438429 None None] MFA Rules not processed for user `97d3a882485740bcbc039b5392b4e6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:18.271697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fc191c76-9947-4a82-bcf6-33d3e1438429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:18.335625 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1400/2807] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:18.340677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422fd74-e8f7-4446-a753-c48e12d78ceb service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:18.350438 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422fd74-e8f7-4446-a753-c48e12d78ceb service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:18.355155 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fdc3e-2633-4989-aa8a-c5b80815274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:18.355796 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fdc3e-2633-4989-aa8a-c5b80815274f admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:18.356069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fdc3e-2633-4989-aa8a-c5b80815274f admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:18.356337 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fdc3e-2633-4989-aa8a-c5b80815274f admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:18.357069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fdc3e-2633-4989-aa8a-c5b80815274f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:18.358955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fdc3e-2633-4989-aa8a-c5b80815274f admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:18.386521 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1408/2808] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:49:18 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:18.390557 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc191c76-9947-4a82-bcf6-33d3e1438429 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:18.401674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc191c76-9947-4a82-bcf6-33d3e1438429 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:18.456968 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c330f8-571a-4e5e-8c01-021fd549ef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:18.457574 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c330f8-571a-4e5e-8c01-021fd549ef21 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:18.457855 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c330f8-571a-4e5e-8c01-021fd549ef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:18.458130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c330f8-571a-4e5e-8c01-021fd549ef21 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:18.458835 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c330f8-571a-4e5e-8c01-021fd549ef21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:18.460772 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c330f8-571a-4e5e-8c01-021fd549ef21 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:18.482137 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1401/2809] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:49:18 2022] POST /identity/v3/users => generated 308 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 07 02:49:18.486125 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fdc3e-2633-4989-aa8a-c5b80815274f admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:18.496080 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fdc3e-2633-4989-aa8a-c5b80815274f admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:18.500586 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c70b2a-3b20-4ab4-a6f1-294fd67720da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:18.501226 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c70b2a-3b20-4ab4-a6f1-294fd67720da admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:18.501503 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c70b2a-3b20-4ab4-a6f1-294fd67720da admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:18.501774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c70b2a-3b20-4ab4-a6f1-294fd67720da admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:18.502495 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c70b2a-3b20-4ab4-a6f1-294fd67720da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:18.504075 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c70b2a-3b20-4ab4-a6f1-294fd67720da admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:18.514845 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1409/2810] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:18.518639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c330f8-571a-4e5e-8c01-021fd549ef21 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:18.528872 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c330f8-571a-4e5e-8c01-021fd549ef21 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:18.533421 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705c42a-fa5c-4e81-a063-828192d1d1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:18.534283 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c42a-fa5c-4e81-a063-828192d1d1af admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:18.534558 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c42a-fa5c-4e81-a063-828192d1d1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:18.534830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c42a-fa5c-4e81-a063-828192d1d1af admin admin] PATH_INFO: `/v3/projects/2ee9e84f2b5e4a03aa4cf5a297dadeb2/users/33b850ef15d449b58035b6a7320f6b7c/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:18.549033 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c42a-fa5c-4e81-a063-828192d1d1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9e84f2b5e4a03aa4cf5a297dadeb2, user_id=33b850ef15d449b58035b6a7320f6b7c, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:18.551639 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c42a-fa5c-4e81-a063-828192d1d1af admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:18.562748 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1402/2811] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:49:18 2022] PUT /identity/v3/projects/2ee9e84f2b5e4a03aa4cf5a297dadeb2/users/33b850ef15d449b58035b6a7320f6b7c/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:18.566497 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c70b2a-3b20-4ab4-a6f1-294fd67720da admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:18.576926 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c70b2a-3b20-4ab4-a6f1-294fd67720da admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:18.629608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807ab10-ce48-4181-bac8-1d66b5690133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:18.630269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ab10-ce48-4181-bac8-1d66b5690133 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:18.630548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ab10-ce48-4181-bac8-1d66b5690133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:18.630818 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807ab10-ce48-4181-bac8-1d66b5690133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:18.631583 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807ab10-ce48-4181-bac8-1d66b5690133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:18.633217 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807ab10-ce48-4181-bac8-1d66b5690133 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:18.643491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1410/2812] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:18.647515 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705c42a-fa5c-4e81-a063-828192d1d1af admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:18.658553 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705c42a-fa5c-4e81-a063-828192d1d1af admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:18.663213 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b832021-1996-4121-894b-13f5765f63c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:18.664088 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b832021-1996-4121-894b-13f5765f63c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:18.664387 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b832021-1996-4121-894b-13f5765f63c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:18.664661 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b832021-1996-4121-894b-13f5765f63c0 admin admin] PATH_INFO: `/v3/projects/2ee9e84f2b5e4a03aa4cf5a297dadeb2/users/33b850ef15d449b58035b6a7320f6b7c/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:18.666592 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b832021-1996-4121-894b-13f5765f63c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee9e84f2b5e4a03aa4cf5a297dadeb2, user_id=33b850ef15d449b58035b6a7320f6b7c, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:18.669222 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b832021-1996-4121-894b-13f5765f63c0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:18.679181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1403/2813] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:49:18 2022] PUT /identity/v3/projects/2ee9e84f2b5e4a03aa4cf5a297dadeb2/users/33b850ef15d449b58035b6a7320f6b7c/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:19.256621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d525b-6ee0-4022-8e8d-4a7026670c07 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:19.256936 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d525b-6ee0-4022-8e8d-4a7026670c07 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:19.257213 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d525b-6ee0-4022-8e8d-4a7026670c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:19.284320 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-411d525b-6ee0-4022-8e8d-4a7026670c07 None None] MFA Rules not processed for user `33b850ef15d449b58035b6a7320f6b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:19.285549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-411d525b-6ee0-4022-8e8d-4a7026670c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:19.353222 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1411/2814] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:20.303321 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b832021-1996-4121-894b-13f5765f63c0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:20.365038 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b832021-1996-4121-894b-13f5765f63c0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:20.369611 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:20.370478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:20.370749 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:20.371024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] PATH_INFO: `/v3/users/97d3a882485740bcbc039b5392b4e6c8` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:20.372228 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d3a882485740bcbc039b5392b4e6c8)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:20.374149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:20.418832 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d3a882485740bcbc039b5392b4e6c8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.425507 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d3a882485740bcbc039b5392b4e6c8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.436674 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d3a882485740bcbc039b5392b4e6c8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.437322 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d3a882485740bcbc039b5392b4e6c8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.444186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d3a882485740bcbc039b5392b4e6c8'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.450206 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1404/2815] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:49:20 2022] DELETE /identity/v3/users/97d3a882485740bcbc039b5392b4e6c8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:20.619001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d525b-6ee0-4022-8e8d-4a7026670c07 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:20.630167 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d525b-6ee0-4022-8e8d-4a7026670c07 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:20.686247 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:20.687124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:20.687403 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:20.687677 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] PATH_INFO: `/v3/projects/de81e69c344f44fe8b29143980c6e59f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:20.688896 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de81e69c344f44fe8b29143980c6e59f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:20.690782 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:20.735201 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de81e69c344f44fe8b29143980c6e59f', 'request_id': 'req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.741137 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de81e69c344f44fe8b29143980c6e59f', 'request_id': 'req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.747864 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de81e69c344f44fe8b29143980c6e59f', 'request_id': 'req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.757481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] The token cache is being invalidate because project de81e69c344f44fe8b29143980c6e59f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:49:20.757765 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.758391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.760478 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1412/2816] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:49:20 2022] DELETE /identity/v3/projects/de81e69c344f44fe8b29143980c6e59f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:20.764482 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:20.765875 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:20.780328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f3451-e98e-49e7-b7e5-cb82a92ace6f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:20.841666 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:20.842453 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:20.842734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:20.843035 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] PATH_INFO: `/v3/users/33b850ef15d449b58035b6a7320f6b7c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:20.844245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b850ef15d449b58035b6a7320f6b7c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:20.846229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:20.890072 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b850ef15d449b58035b6a7320f6b7c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.896684 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b850ef15d449b58035b6a7320f6b7c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.908719 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b850ef15d449b58035b6a7320f6b7c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.909384 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b850ef15d449b58035b6a7320f6b7c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.924359 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41f2359c-1855-4e51-a926-a34b1c7432f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b850ef15d449b58035b6a7320f6b7c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:20.930337 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1405/2817] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:49:20 2022] DELETE /identity/v3/users/33b850ef15d449b58035b6a7320f6b7c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:49:21.095295 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.096681 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:21.109172 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6eb12-5dc1-4a7c-b000-dd38ff884cb8 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.165189 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.166041 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.166324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.166594 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] PATH_INFO: `/v3/projects/2ee9e84f2b5e4a03aa4cf5a297dadeb2` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.167774 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee9e84f2b5e4a03aa4cf5a297dadeb2)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.169708 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.213286 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee9e84f2b5e4a03aa4cf5a297dadeb2', 'request_id': 'req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:21.219106 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee9e84f2b5e4a03aa4cf5a297dadeb2', 'request_id': 'req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:21.225899 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee9e84f2b5e4a03aa4cf5a297dadeb2', 'request_id': 'req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:21.238269 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] The token cache is being invalidate because project 2ee9e84f2b5e4a03aa4cf5a297dadeb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:49:21.238785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:21.239841 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-fa5a4f60-4b4d-4ab5-8325-3623718a3a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:21.241501 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1413/2818] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:49:21 2022] DELETE /identity/v3/projects/2ee9e84f2b5e4a03aa4cf5a297dadeb2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:21.247665 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3252a-ecfc-4654-8aed-75e34adca1c6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.247956 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3252a-ecfc-4654-8aed-75e34adca1c6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.248236 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3252a-ecfc-4654-8aed-75e34adca1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.267790 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-91a3252a-ecfc-4654-8aed-75e34adca1c6 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:21.269024 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-91a3252a-ecfc-4654-8aed-75e34adca1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:21.325247 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1406/2819] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:21.332914 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29948a98-709d-47d1-950d-60a43981db92 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.333203 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29948a98-709d-47d1-950d-60a43981db92 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.333481 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29948a98-709d-47d1-950d-60a43981db92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.351878 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-29948a98-709d-47d1-950d-60a43981db92 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:21.353669 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-29948a98-709d-47d1-950d-60a43981db92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:21.361518 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1414/2820] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:21.365416 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3252a-ecfc-4654-8aed-75e34adca1c6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.375361 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3252a-ecfc-4654-8aed-75e34adca1c6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.379914 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6062b6-9e16-465d-8725-bc80fa7a6d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.380590 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6062b6-9e16-465d-8725-bc80fa7a6d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.380877 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6062b6-9e16-465d-8725-bc80fa7a6d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.381154 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6062b6-9e16-465d-8725-bc80fa7a6d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.381882 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6062b6-9e16-465d-8725-bc80fa7a6d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:49:21.382186 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6062b6-9e16-465d-8725-bc80fa7a6d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.383796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6062b6-9e16-465d-8725-bc80fa7a6d47 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.394906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1407/2821] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:49:21.398905 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29948a98-709d-47d1-950d-60a43981db92 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.407665 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29948a98-709d-47d1-950d-60a43981db92 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.412195 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c4462-f7d8-4a3d-ae14-0bfd2528d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.412859 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c4462-f7d8-4a3d-ae14-0bfd2528d94a admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.413136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c4462-f7d8-4a3d-ae14-0bfd2528d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.413406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c4462-f7d8-4a3d-ae14-0bfd2528d94a admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.414102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c4462-f7d8-4a3d-ae14-0bfd2528d94a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.416519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c4462-f7d8-4a3d-ae14-0bfd2528d94a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.440704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1415/2822] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:49:21 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:21.444583 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6062b6-9e16-465d-8725-bc80fa7a6d47 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.454618 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6062b6-9e16-465d-8725-bc80fa7a6d47 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.508233 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dc550-b702-421a-8794-6d4a55df8eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.508935 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dc550-b702-421a-8794-6d4a55df8eef admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.509218 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dc550-b702-421a-8794-6d4a55df8eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.509494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dc550-b702-421a-8794-6d4a55df8eef admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.510193 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8dc550-b702-421a-8794-6d4a55df8eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.512161 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8dc550-b702-421a-8794-6d4a55df8eef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.533887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1408/2823] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:49:21 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:21.537971 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c4462-f7d8-4a3d-ae14-0bfd2528d94a admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.549140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c4462-f7d8-4a3d-ae14-0bfd2528d94a admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.553906 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afaa25-a173-428e-a348-b4de0cf69d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.554560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afaa25-a173-428e-a348-b4de0cf69d67 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.554834 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afaa25-a173-428e-a348-b4de0cf69d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.555104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afaa25-a173-428e-a348-b4de0cf69d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.556530 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afaa25-a173-428e-a348-b4de0cf69d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.558128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afaa25-a173-428e-a348-b4de0cf69d67 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.568245 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1416/2824] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:21.572329 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dc550-b702-421a-8794-6d4a55df8eef admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.582100 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8dc550-b702-421a-8794-6d4a55df8eef admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.586697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5e896-0a22-42b4-a7f2-02292e130e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.587364 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5e896-0a22-42b4-a7f2-02292e130e12 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.587647 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5e896-0a22-42b4-a7f2-02292e130e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.587922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5e896-0a22-42b4-a7f2-02292e130e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.588681 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5e896-0a22-42b4-a7f2-02292e130e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.590256 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5e896-0a22-42b4-a7f2-02292e130e12 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.600012 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1409/2825] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:21.604190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afaa25-a173-428e-a348-b4de0cf69d67 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.613775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afaa25-a173-428e-a348-b4de0cf69d67 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.619078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875a1d8-9821-4408-9230-86a9305715e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.619931 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875a1d8-9821-4408-9230-86a9305715e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.620212 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875a1d8-9821-4408-9230-86a9305715e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.620536 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875a1d8-9821-4408-9230-86a9305715e5 admin admin] PATH_INFO: `/v3/projects/8338fa75dc234e36a5d543f909719f5f/users/74e15b4b97e347ed9cb7af3c50a3c4f0/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.634922 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875a1d8-9821-4408-9230-86a9305715e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8338fa75dc234e36a5d543f909719f5f, user_id=74e15b4b97e347ed9cb7af3c50a3c4f0, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.637611 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875a1d8-9821-4408-9230-86a9305715e5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.650202 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1417/2826] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:49:21 2022] PUT /identity/v3/projects/8338fa75dc234e36a5d543f909719f5f/users/74e15b4b97e347ed9cb7af3c50a3c4f0/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:49:21.660290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd4884-3454-4c03-96e2-7dd9686e4076 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.660638 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd4884-3454-4c03-96e2-7dd9686e4076 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.660917 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd4884-3454-4c03-96e2-7dd9686e4076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.688229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-61dd4884-3454-4c03-96e2-7dd9686e4076 None None] MFA Rules not processed for user `74e15b4b97e347ed9cb7af3c50a3c4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:21.689493 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-61dd4884-3454-4c03-96e2-7dd9686e4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:21.750909 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1410/2827] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:21.755475 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875a1d8-9821-4408-9230-86a9305715e5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.813724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875a1d8-9821-4408-9230-86a9305715e5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.818352 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7845a-63ff-4322-9c19-76d6d5c4e301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.819001 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7845a-63ff-4322-9c19-76d6d5c4e301 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.819281 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7845a-63ff-4322-9c19-76d6d5c4e301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.819557 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7845a-63ff-4322-9c19-76d6d5c4e301 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.820244 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7845a-63ff-4322-9c19-76d6d5c4e301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.822468 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7845a-63ff-4322-9c19-76d6d5c4e301 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.846575 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1418/2828] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:49:21 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:21.850509 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd4884-3454-4c03-96e2-7dd9686e4076 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.865260 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd4884-3454-4c03-96e2-7dd9686e4076 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.919084 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2de97-157e-40d0-a70c-8b724c24c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.919734 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2de97-157e-40d0-a70c-8b724c24c183 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.920014 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2de97-157e-40d0-a70c-8b724c24c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.920286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2de97-157e-40d0-a70c-8b724c24c183 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.921007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2de97-157e-40d0-a70c-8b724c24c183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.922906 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2de97-157e-40d0-a70c-8b724c24c183 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.942381 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1411/2829] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:49:21 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:21.946918 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7845a-63ff-4322-9c19-76d6d5c4e301 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.957483 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7845a-63ff-4322-9c19-76d6d5c4e301 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.962656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabf9d0-4a7b-409a-a5b0-3b32ef0fed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.963311 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabf9d0-4a7b-409a-a5b0-3b32ef0fed80 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.963593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabf9d0-4a7b-409a-a5b0-3b32ef0fed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.963867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabf9d0-4a7b-409a-a5b0-3b32ef0fed80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:21.964630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabf9d0-4a7b-409a-a5b0-3b32ef0fed80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:21.966228 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabf9d0-4a7b-409a-a5b0-3b32ef0fed80 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:21.976429 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1419/2830] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:21.981185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2de97-157e-40d0-a70c-8b724c24c183 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:21.990884 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2de97-157e-40d0-a70c-8b724c24c183 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:21.995635 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817f0a7-1cc6-4fc5-a915-938f857a81b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:21.996656 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817f0a7-1cc6-4fc5-a915-938f857a81b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:21.996834 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817f0a7-1cc6-4fc5-a915-938f857a81b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:21.997078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817f0a7-1cc6-4fc5-a915-938f857a81b4 admin admin] PATH_INFO: `/v3/projects/2dcc2c234d734805979d95b34a9ec0ee/users/3d1911a549c8401ca20e1dd527803985/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:22.011185 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817f0a7-1cc6-4fc5-a915-938f857a81b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcc2c234d734805979d95b34a9ec0ee, user_id=3d1911a549c8401ca20e1dd527803985, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:22.013860 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817f0a7-1cc6-4fc5-a915-938f857a81b4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:22.027149 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1412/2831] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:49:21 2022] PUT /identity/v3/projects/2dcc2c234d734805979d95b34a9ec0ee/users/3d1911a549c8401ca20e1dd527803985/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:22.031012 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabf9d0-4a7b-409a-a5b0-3b32ef0fed80 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:22.041405 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabf9d0-4a7b-409a-a5b0-3b32ef0fed80 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:22.095724 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb5598-7af5-4019-bf08-eba303c86061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:22.096414 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5598-7af5-4019-bf08-eba303c86061 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:22.096686 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5598-7af5-4019-bf08-eba303c86061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:22.096955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5598-7af5-4019-bf08-eba303c86061 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:22.097700 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb5598-7af5-4019-bf08-eba303c86061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:22.099273 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb5598-7af5-4019-bf08-eba303c86061 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:22.108636 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1420/2832] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:22.112737 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817f0a7-1cc6-4fc5-a915-938f857a81b4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:22.122800 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817f0a7-1cc6-4fc5-a915-938f857a81b4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:22.127338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a12804-3be0-4bd6-af2d-62eecfcde9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:22.128195 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a12804-3be0-4bd6-af2d-62eecfcde9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:22.128511 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a12804-3be0-4bd6-af2d-62eecfcde9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:22.128786 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a12804-3be0-4bd6-af2d-62eecfcde9a5 admin admin] PATH_INFO: `/v3/projects/2dcc2c234d734805979d95b34a9ec0ee/users/3d1911a549c8401ca20e1dd527803985/roles/d6a85718b9d24da5a6b6eaf4dd99d561` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:22.130785 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a12804-3be0-4bd6-af2d-62eecfcde9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcc2c234d734805979d95b34a9ec0ee, user_id=3d1911a549c8401ca20e1dd527803985, role_id=d6a85718b9d24da5a6b6eaf4dd99d561)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:22.133439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a12804-3be0-4bd6-af2d-62eecfcde9a5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:22.143869 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1413/2833] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:49:22 2022] PUT /identity/v3/projects/2dcc2c234d734805979d95b34a9ec0ee/users/3d1911a549c8401ca20e1dd527803985/roles/d6a85718b9d24da5a6b6eaf4dd99d561 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:22.155592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0b88f-ae8c-430a-93ff-18e1f079e305 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:22.155955 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0b88f-ae8c-430a-93ff-18e1f079e305 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:22.156303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0b88f-ae8c-430a-93ff-18e1f079e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:22.183608 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a7a0b88f-ae8c-430a-93ff-18e1f079e305 None None] MFA Rules not processed for user `3d1911a549c8401ca20e1dd527803985`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:22.184839 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a7a0b88f-ae8c-430a-93ff-18e1f079e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:22.248637 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1421/2834] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:22.258043 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a12804-3be0-4bd6-af2d-62eecfcde9a5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:22.260257 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b9a12804-3be0-4bd6-af2d-62eecfcde9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:22.314697 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a12804-3be0-4bd6-af2d-62eecfcde9a5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:22.318330 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab2bc6-1f83-41af-8141-29d401988e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:22.318954 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab2bc6-1f83-41af-8141-29d401988e1d service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:22.319229 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab2bc6-1f83-41af-8141-29d401988e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:22.319498 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab2bc6-1f83-41af-8141-29d401988e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:22.328999 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab2bc6-1f83-41af-8141-29d401988e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:22.330439 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab2bc6-1f83-41af-8141-29d401988e1d service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:22.340267 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1414/2835] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:49:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:49:22.426941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0b88f-ae8c-430a-93ff-18e1f079e305 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:22.436911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0b88f-ae8c-430a-93ff-18e1f079e305 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:22.440571 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880aef4-6b4a-4700-bbb2-04f4e0ef42f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:22.441200 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880aef4-6b4a-4700-bbb2-04f4e0ef42f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:22.441477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880aef4-6b4a-4700-bbb2-04f4e0ef42f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:22.441747 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880aef4-6b4a-4700-bbb2-04f4e0ef42f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:22.495272 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880aef4-6b4a-4700-bbb2-04f4e0ef42f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:22.496731 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880aef4-6b4a-4700-bbb2-04f4e0ef42f5 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:22.505362 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1422/2836] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:49:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:49:25.017916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab2bc6-1f83-41af-8141-29d401988e1d service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:25.077587 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab2bc6-1f83-41af-8141-29d401988e1d service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:25.082102 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:25.082951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:25.083231 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:25.083505 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] PATH_INFO: `/v3/users/74e15b4b97e347ed9cb7af3c50a3c4f0` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:25.084724 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e15b4b97e347ed9cb7af3c50a3c4f0)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:25.086648 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:25.130268 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e15b4b97e347ed9cb7af3c50a3c4f0'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.137086 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e15b4b97e347ed9cb7af3c50a3c4f0'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.153563 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e15b4b97e347ed9cb7af3c50a3c4f0'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.154694 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e15b4b97e347ed9cb7af3c50a3c4f0'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.163444 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e15b4b97e347ed9cb7af3c50a3c4f0'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.170017 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1415/2837] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:49:25 2022] DELETE /identity/v3/users/74e15b4b97e347ed9cb7af3c50a3c4f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:25.174657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ca6a0-ed07-4d60-b09f-54d42c427506 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:25.175447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ca6a0-ed07-4d60-b09f-54d42c427506 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:25.175447 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ca6a0-ed07-4d60-b09f-54d42c427506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:25.194479 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-a11ca6a0-ed07-4d60-b09f-54d42c427506 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:25.195689 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a11ca6a0-ed07-4d60-b09f-54d42c427506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:25.255383 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1423/2838] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:25.265007 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:25.266436 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:25.322131 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16c8e-0ede-44a8-8c20-236c1b3642d1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:25.325775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a567c0-94a1-43b9-a19e-802b81078224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:25.326400 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a567c0-94a1-43b9-a19e-802b81078224 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:25.326676 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a567c0-94a1-43b9-a19e-802b81078224 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:25.326948 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a567c0-94a1-43b9-a19e-802b81078224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:25.335687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a567c0-94a1-43b9-a19e-802b81078224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:25.337286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a567c0-94a1-43b9-a19e-802b81078224 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:25.346479 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1416/2839] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:49:25.603242 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ca6a0-ed07-4d60-b09f-54d42c427506 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:25.604775 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-a11ca6a0-ed07-4d60-b09f-54d42c427506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:25.617990 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ca6a0-ed07-4d60-b09f-54d42c427506 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:25.622960 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:25.623915 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:25.624840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:25.624840 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] PATH_INFO: `/v3/projects/8338fa75dc234e36a5d543f909719f5f` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:25.625704 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8338fa75dc234e36a5d543f909719f5f)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:25.627601 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:25.673738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8338fa75dc234e36a5d543f909719f5f', 'request_id': 'req-33b2dff4-c527-42ac-88ae-f451eb765eb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.679738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8338fa75dc234e36a5d543f909719f5f', 'request_id': 'req-33b2dff4-c527-42ac-88ae-f451eb765eb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.686952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8338fa75dc234e36a5d543f909719f5f', 'request_id': 'req-33b2dff4-c527-42ac-88ae-f451eb765eb7'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.697146 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] The token cache is being invalidate because project 8338fa75dc234e36a5d543f909719f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:49:25.697425 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.698030 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.699540 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1424/2840] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:49:25 2022] DELETE /identity/v3/projects/8338fa75dc234e36a5d543f909719f5f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:25.703488 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a567c0-94a1-43b9-a19e-802b81078224 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:25.713600 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a567c0-94a1-43b9-a19e-802b81078224 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:25.767328 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:25.768183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:25.768500 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:25.768775 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] PATH_INFO: `/v3/users/3d1911a549c8401ca20e1dd527803985` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:25.769952 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1911a549c8401ca20e1dd527803985)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:25.771837 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:25.827236 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1911a549c8401ca20e1dd527803985'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.833858 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1911a549c8401ca20e1dd527803985'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.846160 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1911a549c8401ca20e1dd527803985'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.846843 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1911a549c8401ca20e1dd527803985'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.854096 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c55dde67-a149-4bbe-ba02-baf519c796e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1911a549c8401ca20e1dd527803985'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:25.859889 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1417/2841] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:49:25 2022] DELETE /identity/v3/users/3d1911a549c8401ca20e1dd527803985 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:26.118830 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:26.120304 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:26.134303 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2dff4-c527-42ac-88ae-f451eb765eb7 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:26.189783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:26.190630 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.190911 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.191186 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] PATH_INFO: `/v3/projects/2dcc2c234d734805979d95b34a9ec0ee` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.192400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcc2c234d734805979d95b34a9ec0ee)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:26.194305 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:26.237988 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcc2c234d734805979d95b34a9ec0ee', 'request_id': 'req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:26.252542 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcc2c234d734805979d95b34a9ec0ee', 'request_id': 'req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:26.260187 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcc2c234d734805979d95b34a9ec0ee', 'request_id': 'req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:26.270102 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] The token cache is being invalidate because project 2dcc2c234d734805979d95b34a9ec0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:49:26.270391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:26.271009 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-8377f4ba-8aa2-47c3-8bcc-3d36e32adb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:26.272570 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1425/2842] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:49:26 2022] DELETE /identity/v3/projects/2dcc2c234d734805979d95b34a9ec0ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:26.278191 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41c30-70b6-4ab8-904f-444532ef35a2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.278672 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41c30-70b6-4ab8-904f-444532ef35a2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.278778 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41c30-70b6-4ab8-904f-444532ef35a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.296980 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4bb41c30-70b6-4ab8-904f-444532ef35a2 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:26.298183 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4bb41c30-70b6-4ab8-904f-444532ef35a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:26.355288 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1418/2843] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:26.363162 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e70d9-d2c5-4db1-8f0f-3456e92ecc45 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.363374 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e70d9-d2c5-4db1-8f0f-3456e92ecc45 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.363652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e70d9-d2c5-4db1-8f0f-3456e92ecc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.381902 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-213e70d9-d2c5-4db1-8f0f-3456e92ecc45 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:26.383099 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-213e70d9-d2c5-4db1-8f0f-3456e92ecc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:26.391623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1426/2844] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:26.395580 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb41c30-70b6-4ab8-904f-444532ef35a2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:26.405117 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb41c30-70b6-4ab8-904f-444532ef35a2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:26.409727 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424d2f-3a3b-4c43-8075-2953a6d74c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:26.410367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424d2f-3a3b-4c43-8075-2953a6d74c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.410652 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424d2f-3a3b-4c43-8075-2953a6d74c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.410927 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0424d2f-3a3b-4c43-8075-2953a6d74c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.411654 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0424d2f-3a3b-4c43-8075-2953a6d74c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:49:26.411961 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0424d2f-3a3b-4c43-8075-2953a6d74c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:26.413584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0424d2f-3a3b-4c43-8075-2953a6d74c39 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:26.424687 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1419/2845] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:49:26.428759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e70d9-d2c5-4db1-8f0f-3456e92ecc45 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:26.438380 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e70d9-d2c5-4db1-8f0f-3456e92ecc45 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:26.443027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429a22-dd1c-4448-a3c0-f28c4f36ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:26.443659 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429a22-dd1c-4448-a3c0-f28c4f36ed33 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.443938 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429a22-dd1c-4448-a3c0-f28c4f36ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.444221 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429a22-dd1c-4448-a3c0-f28c4f36ed33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.444962 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22429a22-dd1c-4448-a3c0-f28c4f36ed33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:26.447749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22429a22-dd1c-4448-a3c0-f28c4f36ed33 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:26.471625 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1427/2846] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:49:26 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:26.475575 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424d2f-3a3b-4c43-8075-2953a6d74c39 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:26.485280 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0424d2f-3a3b-4c43-8075-2953a6d74c39 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:26.539171 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918e6d2-0212-499a-b427-6bd74b505e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:26.539824 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918e6d2-0212-499a-b427-6bd74b505e35 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.540108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918e6d2-0212-499a-b427-6bd74b505e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.540440 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918e6d2-0212-499a-b427-6bd74b505e35 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.541139 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918e6d2-0212-499a-b427-6bd74b505e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:26.543042 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918e6d2-0212-499a-b427-6bd74b505e35 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:26.562447 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1420/2847] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:49:26 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:26.566432 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429a22-dd1c-4448-a3c0-f28c4f36ed33 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:26.577284 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429a22-dd1c-4448-a3c0-f28c4f36ed33 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:26.581867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32da1f-fba4-4b70-af56-61af1e7a30b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:26.582516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32da1f-fba4-4b70-af56-61af1e7a30b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.582794 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32da1f-fba4-4b70-af56-61af1e7a30b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.583070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32da1f-fba4-4b70-af56-61af1e7a30b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.583795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32da1f-fba4-4b70-af56-61af1e7a30b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:26.585440 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32da1f-fba4-4b70-af56-61af1e7a30b5 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:26.595471 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1428/2848] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:26.599068 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918e6d2-0212-499a-b427-6bd74b505e35 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:26.609389 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918e6d2-0212-499a-b427-6bd74b505e35 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:26.614041 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22573942-1afa-47ac-8d1e-4a994dce72ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:26.614620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22573942-1afa-47ac-8d1e-4a994dce72ea admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.614899 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22573942-1afa-47ac-8d1e-4a994dce72ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.615172 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22573942-1afa-47ac-8d1e-4a994dce72ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.615898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22573942-1afa-47ac-8d1e-4a994dce72ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:26.617503 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22573942-1afa-47ac-8d1e-4a994dce72ea admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:26.628240 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1421/2849] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:26.632254 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32da1f-fba4-4b70-af56-61af1e7a30b5 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:26.641991 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32da1f-fba4-4b70-af56-61af1e7a30b5 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:26.646605 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70a93a-73b5-4d0f-a122-aec24aeaa16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:26.647464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70a93a-73b5-4d0f-a122-aec24aeaa16b admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.647738 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70a93a-73b5-4d0f-a122-aec24aeaa16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.648005 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70a93a-73b5-4d0f-a122-aec24aeaa16b admin admin] PATH_INFO: `/v3/projects/e85ade6f30964b519aafc377e9be83c7/users/7f52eb87a16745638f004a16c41ed9df/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.661976 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70a93a-73b5-4d0f-a122-aec24aeaa16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85ade6f30964b519aafc377e9be83c7, user_id=7f52eb87a16745638f004a16c41ed9df, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:26.664621 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70a93a-73b5-4d0f-a122-aec24aeaa16b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:26.677610 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1429/2850] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:49:26 2022] PUT /identity/v3/projects/e85ade6f30964b519aafc377e9be83c7/users/7f52eb87a16745638f004a16c41ed9df/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:26.688428 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9f066-dd76-420a-b894-273eff3b8029 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.688723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9f066-dd76-420a-b894-273eff3b8029 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.689002 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9f066-dd76-420a-b894-273eff3b8029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.715235 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d5e9f066-dd76-420a-b894-273eff3b8029 None None] MFA Rules not processed for user `7f52eb87a16745638f004a16c41ed9df`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:26.716484 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d5e9f066-dd76-420a-b894-273eff3b8029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:26.782202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1422/2851] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:26.791981 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70a93a-73b5-4d0f-a122-aec24aeaa16b admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:26.793800 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bb70a93a-73b5-4d0f-a122-aec24aeaa16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:26.848128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70a93a-73b5-4d0f-a122-aec24aeaa16b admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:26.851768 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dd3ee-38b1-498f-b4b9-5861a1e7c482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:26.852446 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dd3ee-38b1-498f-b4b9-5861a1e7c482 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:26.852729 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dd3ee-38b1-498f-b4b9-5861a1e7c482 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:26.853004 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dd3ee-38b1-498f-b4b9-5861a1e7c482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:26.861268 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dd3ee-38b1-498f-b4b9-5861a1e7c482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:26.862702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dd3ee-38b1-498f-b4b9-5861a1e7c482 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:26.871288 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1430/2852] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:49:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:49:45.182245 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9f066-dd76-420a-b894-273eff3b8029 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:45.243181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9f066-dd76-420a-b894-273eff3b8029 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:45.248519 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:45.249373 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:45.249651 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:45.249922 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] PATH_INFO: `/v3/users/7f52eb87a16745638f004a16c41ed9df` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:45.251119 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f52eb87a16745638f004a16c41ed9df)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:45.253059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:45.296127 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f52eb87a16745638f004a16c41ed9df'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.302794 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f52eb87a16745638f004a16c41ed9df'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.314547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f52eb87a16745638f004a16c41ed9df'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.315198 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f52eb87a16745638f004a16c41ed9df'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.321641 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f52eb87a16745638f004a16c41ed9df'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.328059 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1423/2853] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:49:45 2022] DELETE /identity/v3/users/7f52eb87a16745638f004a16c41ed9df => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:45.332505 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d09f-b16b-4915-9350-0abf5df4328e None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:45.332966 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d09f-b16b-4915-9350-0abf5df4328e None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:45.333063 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036d09f-b16b-4915-9350-0abf5df4328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:45.351288 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-0036d09f-b16b-4915-9350-0abf5df4328e None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:45.352491 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0036d09f-b16b-4915-9350-0abf5df4328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:45.408766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1431/2854] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:45.418612 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:45.420052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:45.475483 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e125f-43b5-4848-927d-6025d5e88df7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:45.479120 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8e735-82a8-4766-9b04-62dd1bce3aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:45.479757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e735-82a8-4766-9b04-62dd1bce3aeb service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:45.480040 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e735-82a8-4766-9b04-62dd1bce3aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:45.480316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e735-82a8-4766-9b04-62dd1bce3aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:45.489883 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8e735-82a8-4766-9b04-62dd1bce3aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:45.491358 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8e735-82a8-4766-9b04-62dd1bce3aeb service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:45.500840 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1424/2855] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:49:45.755266 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d09f-b16b-4915-9350-0abf5df4328e None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:45.756771 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-0036d09f-b16b-4915-9350-0abf5df4328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:45.769666 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036d09f-b16b-4915-9350-0abf5df4328e None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:45.774493 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:45.775341 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:45.775615 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:45.775883 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] PATH_INFO: `/v3/projects/e85ade6f30964b519aafc377e9be83c7` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:45.777173 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85ade6f30964b519aafc377e9be83c7)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:45.779104 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:45.824477 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85ade6f30964b519aafc377e9be83c7', 'request_id': 'req-caaa8301-241f-45b3-93ba-fa1c0358a45b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.830338 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85ade6f30964b519aafc377e9be83c7', 'request_id': 'req-caaa8301-241f-45b3-93ba-fa1c0358a45b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.837406 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85ade6f30964b519aafc377e9be83c7', 'request_id': 'req-caaa8301-241f-45b3-93ba-fa1c0358a45b'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.847465 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] The token cache is being invalidate because project e85ade6f30964b519aafc377e9be83c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79277) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:49:45.847749 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.848393 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-caaa8301-241f-45b3-93ba-fa1c0358a45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:49:45.849895 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1432/2856] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:49:45 2022] DELETE /identity/v3/projects/e85ade6f30964b519aafc377e9be83c7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:45.856897 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf8c0-24dc-4014-9d68-582d2f7fc890 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:45.857184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf8c0-24dc-4014-9d68-582d2f7fc890 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:45.857460 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cf8c0-24dc-4014-9d68-582d2f7fc890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:45.875630 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-484cf8c0-24dc-4014-9d68-582d2f7fc890 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:45.876849 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-484cf8c0-24dc-4014-9d68-582d2f7fc890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:45.935541 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1425/2857] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:45.943437 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2cc5f-549a-464d-9e7d-f86e8f4b123d None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:45.943733 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2cc5f-549a-464d-9e7d-f86e8f4b123d None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:45.944007 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2cc5f-549a-464d-9e7d-f86e8f4b123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:45.962649 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-92c2cc5f-549a-464d-9e7d-f86e8f4b123d None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:45.963832 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-92c2cc5f-549a-464d-9e7d-f86e8f4b123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:45.971656 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1433/2858] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:45.975547 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cf8c0-24dc-4014-9d68-582d2f7fc890 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:45.985726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cf8c0-24dc-4014-9d68-582d2f7fc890 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:45.990700 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec579d5-958f-4d51-9eab-f1146ccfcde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:45.991494 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec579d5-958f-4d51-9eab-f1146ccfcde9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:45.991780 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec579d5-958f-4d51-9eab-f1146ccfcde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:45.992106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec579d5-958f-4d51-9eab-f1146ccfcde9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:45.992996 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec579d5-958f-4d51-9eab-f1146ccfcde9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:49:45.993349 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec579d5-958f-4d51-9eab-f1146ccfcde9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:45.995248 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec579d5-958f-4d51-9eab-f1146ccfcde9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:46.007584 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1426/2859] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:49:46.011719 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2cc5f-549a-464d-9e7d-f86e8f4b123d None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:46.020783 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2cc5f-549a-464d-9e7d-f86e8f4b123d None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:46.025400 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e46223-1326-40f6-b26f-b201e3aa69c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:46.026038 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e46223-1326-40f6-b26f-b201e3aa69c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:46.026317 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e46223-1326-40f6-b26f-b201e3aa69c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:46.026593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e46223-1326-40f6-b26f-b201e3aa69c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:46.027280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e46223-1326-40f6-b26f-b201e3aa69c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:46.029357 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e46223-1326-40f6-b26f-b201e3aa69c2 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:46.056124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1434/2860] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:49:46 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:46.060747 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec579d5-958f-4d51-9eab-f1146ccfcde9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:46.070465 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec579d5-958f-4d51-9eab-f1146ccfcde9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:46.125368 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e4b0b-e94c-48b9-b4a4-1ff20b2c8f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:46.126052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e4b0b-e94c-48b9-b4a4-1ff20b2c8f17 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:46.126330 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e4b0b-e94c-48b9-b4a4-1ff20b2c8f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:46.126603 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e4b0b-e94c-48b9-b4a4-1ff20b2c8f17 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:46.127354 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e4b0b-e94c-48b9-b4a4-1ff20b2c8f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:46.129317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e4b0b-e94c-48b9-b4a4-1ff20b2c8f17 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:46.148066 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1427/2861] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:49:46 2022] POST /identity/v3/users => generated 282 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:49:46.152085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e46223-1326-40f6-b26f-b201e3aa69c2 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:46.162230 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e46223-1326-40f6-b26f-b201e3aa69c2 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:46.166953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f84e7-6d2e-45d9-b8e0-9152692dd48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:46.168165 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f84e7-6d2e-45d9-b8e0-9152692dd48e admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:46.168469 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f84e7-6d2e-45d9-b8e0-9152692dd48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:46.168766 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f84e7-6d2e-45d9-b8e0-9152692dd48e admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:46.169524 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f84e7-6d2e-45d9-b8e0-9152692dd48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:46.171158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f84e7-6d2e-45d9-b8e0-9152692dd48e admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:46.181285 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1435/2862] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:49:46.185707 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e4b0b-e94c-48b9-b4a4-1ff20b2c8f17 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:46.195316 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e4b0b-e94c-48b9-b4a4-1ff20b2c8f17 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:46.200128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca8b0b-7ebe-489a-b656-e60b7dced198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:46.200797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca8b0b-7ebe-489a-b656-e60b7dced198 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:46.201078 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca8b0b-7ebe-489a-b656-e60b7dced198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:46.201351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca8b0b-7ebe-489a-b656-e60b7dced198 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:46.202073 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca8b0b-7ebe-489a-b656-e60b7dced198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:46.203627 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca8b0b-7ebe-489a-b656-e60b7dced198 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:46.213226 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1428/2863] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 07 02:49:46.217237 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f84e7-6d2e-45d9-b8e0-9152692dd48e admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:46.226711 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f84e7-6d2e-45d9-b8e0-9152692dd48e admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:46.231788 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dc05d-c33e-47a5-b160-cae3611a20b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:46.232673 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dc05d-c33e-47a5-b160-cae3611a20b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:46.232953 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dc05d-c33e-47a5-b160-cae3611a20b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:46.233227 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dc05d-c33e-47a5-b160-cae3611a20b0 admin admin] PATH_INFO: `/v3/projects/b7aa103494b0446d93389d4fc57fd962/users/8e72a4fbc73e45659a9ca2ac22fb965a/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:46.247558 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dc05d-c33e-47a5-b160-cae3611a20b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa103494b0446d93389d4fc57fd962, user_id=8e72a4fbc73e45659a9ca2ac22fb965a, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:46.250090 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dc05d-c33e-47a5-b160-cae3611a20b0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:46.262294 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1436/2864] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:49:46 2022] PUT /identity/v3/projects/b7aa103494b0446d93389d4fc57fd962/users/8e72a4fbc73e45659a9ca2ac22fb965a/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:49:46.272065 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f051-5bfa-4646-97e7-2bdf7fce4b11 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:46.272371 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f051-5bfa-4646-97e7-2bdf7fce4b11 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:46.272657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f051-5bfa-4646-97e7-2bdf7fce4b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:46.299951 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b589f051-5bfa-4646-97e7-2bdf7fce4b11 None None] MFA Rules not processed for user `8e72a4fbc73e45659a9ca2ac22fb965a`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:49:46.301181 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b589f051-5bfa-4646-97e7-2bdf7fce4b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:46.362134 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1429/2865] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:49:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:49:46.372448 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dc05d-c33e-47a5-b160-cae3611a20b0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:49:46.374190 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-822dc05d-c33e-47a5-b160-cae3611a20b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:49:46.427391 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dc05d-c33e-47a5-b160-cae3611a20b0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:49:46.430960 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c957e1-1817-4e85-b6e1-0c64ed9ca569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:49:46.431590 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c957e1-1817-4e85-b6e1-0c64ed9ca569 service cinder] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:49:46.431868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c957e1-1817-4e85-b6e1-0c64ed9ca569 service cinder] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:49:46.432140 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c957e1-1817-4e85-b6e1-0c64ed9ca569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:49:46.440085 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c957e1-1817-4e85-b6e1-0c64ed9ca569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:49:46.441642 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c957e1-1817-4e85-b6e1-0c64ed9ca569 service cinder] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:49:46.450334 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1437/2866] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:49:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:50:09.918982 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f051-5bfa-4646-97e7-2bdf7fce4b11 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:09.920598 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b589f051-5bfa-4646-97e7-2bdf7fce4b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:09.988219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f051-5bfa-4646-97e7-2bdf7fce4b11 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:09.991760 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd69dd-3762-4de0-9894-4364cc34be8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:09.992456 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd69dd-3762-4de0-9894-4364cc34be8e service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:09.992743 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd69dd-3762-4de0-9894-4364cc34be8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:09.993026 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd69dd-3762-4de0-9894-4364cc34be8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:09.994796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-affd69dd-3762-4de0-9894-4364cc34be8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:10.073809 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd69dd-3762-4de0-9894-4364cc34be8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:10.075281 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd69dd-3762-4de0-9894-4364cc34be8e service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:10.089030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1430/2867] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:50:16.454319 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c957e1-1817-4e85-b6e1-0c64ed9ca569 service cinder] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:16.455825 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-b3c957e1-1817-4e85-b6e1-0c64ed9ca569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:16.469691 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c957e1-1817-4e85-b6e1-0c64ed9ca569 service cinder] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:16.474233 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:16.475078 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:16.475349 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:16.475613 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] PATH_INFO: `/v3/users/f182c5215d37423da1a00cbb98757957` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:16.476817 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f182c5215d37423da1a00cbb98757957)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:16.478712 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:16.522264 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f182c5215d37423da1a00cbb98757957'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.529607 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f182c5215d37423da1a00cbb98757957'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.536158 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f182c5215d37423da1a00cbb98757957'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.547280 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f182c5215d37423da1a00cbb98757957'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.547910 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f182c5215d37423da1a00cbb98757957'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.553527 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1438/2868] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:50:16 2022] DELETE /identity/v3/users/f182c5215d37423da1a00cbb98757957 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:50:16.740128 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd69dd-3762-4de0-9894-4364cc34be8e service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:16.751752 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd69dd-3762-4de0-9894-4364cc34be8e service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:16.816685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:16.817549 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:16.817830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:16.818106 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] PATH_INFO: `/v3/projects/a90c5dfb972244c1aa625e07b1e3fe40` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:16.819367 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90c5dfb972244c1aa625e07b1e3fe40)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:16.821474 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:16.868098 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90c5dfb972244c1aa625e07b1e3fe40', 'request_id': 'req-90aea2da-5722-4208-a93f-7c25a52cd641'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.874832 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90c5dfb972244c1aa625e07b1e3fe40', 'request_id': 'req-90aea2da-5722-4208-a93f-7c25a52cd641'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.880062 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90c5dfb972244c1aa625e07b1e3fe40', 'request_id': 'req-90aea2da-5722-4208-a93f-7c25a52cd641'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.891010 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] The token cache is being invalidate because project a90c5dfb972244c1aa625e07b1e3fe40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:50:16.891289 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.891898 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:16.893480 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1431/2869] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:50:16 2022] DELETE /identity/v3/projects/a90c5dfb972244c1aa625e07b1e3fe40 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:50:16.897519 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:16.898969 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:16.913250 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5fba-22f3-48ab-b09a-27f4490984e0 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:16.970402 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:16.971185 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:16.971464 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:16.971740 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] PATH_INFO: `/v3/users/887c4d1919544712a623981a7e6b7604` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:16.972992 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] RBAC: Authorizing `identity:delete_user(user_id=887c4d1919544712a623981a7e6b7604)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:16.974952 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:17.018309 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887c4d1919544712a623981a7e6b7604'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.025970 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887c4d1919544712a623981a7e6b7604'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.032648 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887c4d1919544712a623981a7e6b7604'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.044318 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887c4d1919544712a623981a7e6b7604'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.044979 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887c4d1919544712a623981a7e6b7604'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.050683 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1439/2870] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:50:16 2022] DELETE /identity/v3/users/887c4d1919544712a623981a7e6b7604 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 07 02:50:17.216757 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:17.218308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:17.231453 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aea2da-5722-4208-a93f-7c25a52cd641 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:17.289561 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:17.290455 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:17.290739 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:17.291016 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] PATH_INFO: `/v3/projects/50366d8339e8453d810e04b48706f155` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:17.292259 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50366d8339e8453d810e04b48706f155)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:17.294797 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:17.338404 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50366d8339e8453d810e04b48706f155', 'request_id': 'req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.344893 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50366d8339e8453d810e04b48706f155', 'request_id': 'req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.350196 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50366d8339e8453d810e04b48706f155', 'request_id': 'req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.362351 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] The token cache is being invalidate because project 50366d8339e8453d810e04b48706f155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:50:17.362633 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.363271 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c6ccc1e2-0bff-4db8-bbeb-9109e7f73c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:17.364830 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1432/2871] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:50:17 2022] DELETE /identity/v3/projects/50366d8339e8453d810e04b48706f155 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:50:20.043355 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:20.044785 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:20.057027 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ab92f-d107-4746-9622-b65a09e9144d admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:20.110119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:20.110967 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:20.111239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:20.111506 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] PATH_INFO: `/v3/users/8e72a4fbc73e45659a9ca2ac22fb965a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:20.112723 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e72a4fbc73e45659a9ca2ac22fb965a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:20.114623 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:20.158070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e72a4fbc73e45659a9ca2ac22fb965a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.164833 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e72a4fbc73e45659a9ca2ac22fb965a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.171959 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e72a4fbc73e45659a9ca2ac22fb965a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.183348 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e72a4fbc73e45659a9ca2ac22fb965a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.184548 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e72a4fbc73e45659a9ca2ac22fb965a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.190156 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1440/2872] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:50:20 2022] DELETE /identity/v3/users/8e72a4fbc73e45659a9ca2ac22fb965a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:50:20.194685 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779a86-bf60-4aa4-b40f-4377bc9c98c0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:20.195160 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779a86-bf60-4aa4-b40f-4377bc9c98c0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:20.195277 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779a86-bf60-4aa4-b40f-4377bc9c98c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:20.214053 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-98779a86-bf60-4aa4-b40f-4377bc9c98c0 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:50:20.215291 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-98779a86-bf60-4aa4-b40f-4377bc9c98c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:20.272664 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1433/2873] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:50:20.282330 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:20.283759 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:20.340602 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e62c-0897-49ad-95d0-495da4c795a4 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:20.344189 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e87a-f4e9-4c68-b7ec-aaf4e722d448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:20.344843 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e87a-f4e9-4c68-b7ec-aaf4e722d448 service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:20.345120 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e87a-f4e9-4c68-b7ec-aaf4e722d448 service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:20.345392 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e87a-f4e9-4c68-b7ec-aaf4e722d448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:20.354136 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898e87a-f4e9-4c68-b7ec-aaf4e722d448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:20.355550 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898e87a-f4e9-4c68-b7ec-aaf4e722d448 service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:20.364634 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1441/2874] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:50:20.612657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98779a86-bf60-4aa4-b40f-4377bc9c98c0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:20.614052 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-98779a86-bf60-4aa4-b40f-4377bc9c98c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:20.627369 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98779a86-bf60-4aa4-b40f-4377bc9c98c0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:20.632202 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:20.633111 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:20.633392 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:20.633669 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] PATH_INFO: `/v3/projects/b7aa103494b0446d93389d4fc57fd962` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:20.634890 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7aa103494b0446d93389d4fc57fd962)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:20.636887 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:20.682462 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7aa103494b0446d93389d4fc57fd962', 'request_id': 'req-57c55426-28c0-48af-ba91-7f2eef2badab'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.689108 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7aa103494b0446d93389d4fc57fd962', 'request_id': 'req-57c55426-28c0-48af-ba91-7f2eef2badab'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.694338 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7aa103494b0446d93389d4fc57fd962', 'request_id': 'req-57c55426-28c0-48af-ba91-7f2eef2badab'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.706485 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] The token cache is being invalidate because project b7aa103494b0446d93389d4fc57fd962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:50:20.706771 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.707423 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-57c55426-28c0-48af-ba91-7f2eef2badab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:20.708974 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1434/2875] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:50:20 2022] DELETE /identity/v3/projects/b7aa103494b0446d93389d4fc57fd962 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:50:20.714627 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97300e6-4dd7-4579-b593-de3110d9d425 None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:20.714944 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97300e6-4dd7-4579-b593-de3110d9d425 None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:20.715224 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97300e6-4dd7-4579-b593-de3110d9d425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:20.733262 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-f97300e6-4dd7-4579-b593-de3110d9d425 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:50:20.734452 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f97300e6-4dd7-4579-b593-de3110d9d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:20.789509 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1442/2876] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:50:20.797410 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7b2d8-e8ca-4223-8e9e-c308b8d46ebe None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:20.797722 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7b2d8-e8ca-4223-8e9e-c308b8d46ebe None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:20.798001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7b2d8-e8ca-4223-8e9e-c308b8d46ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:20.816538 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3ef7b2d8-e8ca-4223-8e9e-c308b8d46ebe None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:50:20.817726 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3ef7b2d8-e8ca-4223-8e9e-c308b8d46ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:20.825846 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1435/2877] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:50:20.829743 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97300e6-4dd7-4579-b593-de3110d9d425 None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:20.839091 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97300e6-4dd7-4579-b593-de3110d9d425 None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:20.844119 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375e4fe-9851-4605-b3de-82e5c26c8a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:20.844795 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375e4fe-9851-4605-b3de-82e5c26c8a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:20.845074 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375e4fe-9851-4605-b3de-82e5c26c8a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:20.845350 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375e4fe-9851-4605-b3de-82e5c26c8a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:20.846069 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375e4fe-9851-4605-b3de-82e5c26c8a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79277) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 07 02:50:20.846372 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375e4fe-9851-4605-b3de-82e5c26c8a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:20.847958 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375e4fe-9851-4605-b3de-82e5c26c8a72 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:20.859643 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1443/2878] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Feb 7 02:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 07 02:50:20.863793 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7b2d8-e8ca-4223-8e9e-c308b8d46ebe None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:20.872777 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7b2d8-e8ca-4223-8e9e-c308b8d46ebe None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:20.877315 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71947-a133-48ff-8660-3f52da77efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:20.877946 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71947-a133-48ff-8660-3f52da77efa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:20.878223 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71947-a133-48ff-8660-3f52da77efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:20.878496 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb71947-a133-48ff-8660-3f52da77efa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:20.879190 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb71947-a133-48ff-8660-3f52da77efa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:20.881092 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb71947-a133-48ff-8660-3f52da77efa3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:20.906473 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1436/2879] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Feb 7 02:50:20 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:50:20.910702 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375e4fe-9851-4605-b3de-82e5c26c8a72 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:20.921128 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375e4fe-9851-4605-b3de-82e5c26c8a72 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:20.973941 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ea198-6131-46cd-856c-6cb72f6835d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:20.974587 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ea198-6131-46cd-856c-6cb72f6835d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:20.974867 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ea198-6131-46cd-856c-6cb72f6835d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:20.975139 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ea198-6131-46cd-856c-6cb72f6835d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:20.975860 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ea198-6131-46cd-856c-6cb72f6835d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:20.977789 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ea198-6131-46cd-856c-6cb72f6835d3 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:20.997868 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1444/2880] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Feb 7 02:50:20 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 07 02:50:21.001916 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71947-a133-48ff-8660-3f52da77efa3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:21.012657 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb71947-a133-48ff-8660-3f52da77efa3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:21.017297 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f2eac-de4f-4327-8ff4-b78b71189a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:21.017934 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2eac-de4f-4327-8ff4-b78b71189a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:21.018209 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2eac-de4f-4327-8ff4-b78b71189a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:21.018478 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f2eac-de4f-4327-8ff4-b78b71189a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:21.019199 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f2eac-de4f-4327-8ff4-b78b71189a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:21.020820 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f2eac-de4f-4327-8ff4-b78b71189a5b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:21.032130 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1437/2881] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:50:21.035928 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ea198-6131-46cd-856c-6cb72f6835d3 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:21.046314 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ea198-6131-46cd-856c-6cb72f6835d3 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:21.051070 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e635d-51a6-4a8b-bdc5-ebe43b567c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:21.051718 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e635d-51a6-4a8b-bdc5-ebe43b567c9a admin admin] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:21.051993 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e635d-51a6-4a8b-bdc5-ebe43b567c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:21.052263 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e635d-51a6-4a8b-bdc5-ebe43b567c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:21.053020 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e635d-51a6-4a8b-bdc5-ebe43b567c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:21.054598 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e635d-51a6-4a8b-bdc5-ebe43b567c9a admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:21.064757 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1445/2882] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Feb 7 02:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 07 02:50:21.068740 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f2eac-de4f-4327-8ff4-b78b71189a5b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:21.079317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f2eac-de4f-4327-8ff4-b78b71189a5b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:21.083863 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8fdfd-36bc-4797-91e6-13e1bda204fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:21.084774 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8fdfd-36bc-4797-91e6-13e1bda204fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:21.085050 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8fdfd-36bc-4797-91e6-13e1bda204fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:21.085317 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8fdfd-36bc-4797-91e6-13e1bda204fc admin admin] PATH_INFO: `/v3/projects/12f0cddd2c8941abbfc997bcad5d86cf/users/f933818b739a4729965ca12eac6f670a/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:21.099216 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8fdfd-36bc-4797-91e6-13e1bda204fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f0cddd2c8941abbfc997bcad5d86cf, user_id=f933818b739a4729965ca12eac6f670a, role_id=f52d23c0f78f4ad8bd0cb8f0a3bacdd9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:21.101850 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8fdfd-36bc-4797-91e6-13e1bda204fc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:21.114290 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1438/2883] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Feb 7 02:50:21 2022] PUT /identity/v3/projects/12f0cddd2c8941abbfc997bcad5d86cf/users/f933818b739a4729965ca12eac6f670a/roles/f52d23c0f78f4ad8bd0cb8f0a3bacdd9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:50:21.125028 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d5d6b-f52c-4d91-8925-20032643597c None None] REQUEST_METHOD: `POST` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:21.125316 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d5d6b-f52c-4d91-8925-20032643597c None None] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:21.125592 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d5d6b-f52c-4d91-8925-20032643597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:21.151549 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.auth.core [None req-588d5d6b-f52c-4d91-8925-20032643597c None None] MFA Rules not processed for user `f933818b739a4729965ca12eac6f670a`. Rule list: `[]` (Enabled: `True`). {{(pid=79277) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:50:21.152813 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-588d5d6b-f52c-4d91-8925-20032643597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:21.213645 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1446/2884] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:50:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 07 02:50:21.223487 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8fdfd-36bc-4797-91e6-13e1bda204fc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:21.225184 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1fe8fdfd-36bc-4797-91e6-13e1bda204fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:21.279723 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8fdfd-36bc-4797-91e6-13e1bda204fc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:21.283390 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc7499-fb83-4abc-8bb6-16b22e8b5255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e738156764e4b038adc89cf114ccda3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:21.284020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc7499-fb83-4abc-8bb6-16b22e8b5255 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:21.284301 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc7499-fb83-4abc-8bb6-16b22e8b5255 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:21.284617 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc7499-fb83-4abc-8bb6-16b22e8b5255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:21.292796 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc7499-fb83-4abc-8bb6-16b22e8b5255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:21.294706 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc7499-fb83-4abc-8bb6-16b22e8b5255 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:21.303433 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1439/2885] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:50:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:50:21.328698 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d5d6b-f52c-4d91-8925-20032643597c None None] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:21.387376 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d5d6b-f52c-4d91-8925-20032643597c None None] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:21.391972 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:21.392849 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:21.393124 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:21.393395 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] PATH_INFO: `/v3/users/f933818b739a4729965ca12eac6f670a` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:21.394591 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f933818b739a4729965ca12eac6f670a)` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:21.396516 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:21.439846 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f933818b739a4729965ca12eac6f670a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:21.446978 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f933818b739a4729965ca12eac6f670a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:21.454093 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f933818b739a4729965ca12eac6f670a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:21.467031 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f933818b739a4729965ca12eac6f670a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:21.467705 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.notifications [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f933818b739a4729965ca12eac6f670a'} {{(pid=79277) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:21.473657 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1447/2886] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Feb 7 02:50:21 2022] DELETE /identity/v3/users/f933818b739a4729965ca12eac6f670a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:50:21.478123 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ba9b6-4506-477b-a57f-da311e18d296 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:21.478406 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ba9b6-4506-477b-a57f-da311e18d296 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:21.478678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ba9b6-4506-477b-a57f-da311e18d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:21.495678 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4c4ba9b6-4506-477b-a57f-da311e18d296 None None] MFA Rules not processed for user `e0df9a34c2c246f2a37da6d5472f7d68`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 07 02:50:21.496998 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4c4ba9b6-4506-477b-a57f-da311e18d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:21.555219 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1440/2887] 10.222.0.15 () {58 vars in 957 bytes} [Mon Feb 7 02:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 07 02:50:21.565208 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:21.566593 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:21.620560 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e430d9-9713-4d75-8ec3-ece554d56569 admin admin] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:21.624652 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da7503-9df1-4622-85c1-762147aa6dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3922641f7c846da98457824bec58652', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:21.625288 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da7503-9df1-4622-85c1-762147aa6dab service neutron] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:21.625563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da7503-9df1-4622-85c1-762147aa6dab service neutron] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:21.625831 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da7503-9df1-4622-85c1-762147aa6dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:21.634851 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da7503-9df1-4622-85c1-762147aa6dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:21.636283 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da7503-9df1-4622-85c1-762147aa6dab service neutron] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:21.645964 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1448/2888] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 07 02:50:21.908510 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ba9b6-4506-477b-a57f-da311e18d296 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:50:21.910030 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4c4ba9b6-4506-477b-a57f-da311e18d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:50:21.922644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ba9b6-4506-477b-a57f-da311e18d296 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:50:21.927286 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0df9a34c2c246f2a37da6d5472f7d68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0b1044bcdc94a2da05a52b6795082d0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:50:21.928136 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:50:21.928518 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:50:21.928798 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] PATH_INFO: `/v3/projects/12f0cddd2c8941abbfc997bcad5d86cf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:50:21.930001 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f0cddd2c8941abbfc997bcad5d86cf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:50:21.931895 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:50:21.981308 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f0cddd2c8941abbfc997bcad5d86cf', 'request_id': 'req-f8449d2b-7088-4fbe-9988-ead4c365f161'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:21.987620 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f0cddd2c8941abbfc997bcad5d86cf', 'request_id': 'req-f8449d2b-7088-4fbe-9988-ead4c365f161'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:21.993020 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f0cddd2c8941abbfc997bcad5d86cf', 'request_id': 'req-f8449d2b-7088-4fbe-9988-ead4c365f161'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:22.005644 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] The token cache is being invalidate because project 12f0cddd2c8941abbfc997bcad5d86cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 07 02:50:22.005932 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:22.006567 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f8449d2b-7088-4fbe-9988-ead4c365f161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 07 02:50:22.008133 dv-cinder-828061-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1441/2889] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Feb 7 02:50:21 2022] DELETE /identity/v3/projects/12f0cddd2c8941abbfc997bcad5d86cf => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 07 02:53:47.575563 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da7503-9df1-4622-85c1-762147aa6dab service neutron] Authenticating user token {{(pid=79277) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 07 02:53:47.576983 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-13da7503-9df1-4622-85c1-762147aa6dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:53:47.689888 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da7503-9df1-4622-85c1-762147aa6dab service neutron] Validating token access rules against request {{(pid=79277) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 07 02:53:47.746324 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f73f9-d143-4311-9c0b-162c2d95228d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06b37b8f23946ebbb5083a877274ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42d4c002199847628d4f618bad7022db', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79277) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 07 02:53:47.746960 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f73f9-d143-4311-9c0b-162c2d95228d service placement] REQUEST_METHOD: `GET` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 07 02:53:47.747239 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f73f9-d143-4311-9c0b-162c2d95228d service placement] SCRIPT_NAME: `/identity` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 07 02:53:47.747512 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f73f9-d143-4311-9c0b-162c2d95228d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79277) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 07 02:53:47.749282 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.fernet_utils [None req-bf7f73f9-d143-4311-9c0b-162c2d95228d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79277) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 07 02:53:47.760061 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f73f9-d143-4311-9c0b-162c2d95228d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 07 02:53:47.761654 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f73f9-d143-4311-9c0b-162c2d95228d service placement] RBAC: Authorization granted {{(pid=79277) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 07 02:53:47.771321 dv-cinder-828061-1-iscsi devstack@keystone.service[79277]: [pid: 79277|app: 0|req: 1449/2890] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Feb 7 02:53:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)